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Abstract 

We study monic polynomials Qri{x) generated by a high order three-term recursion 
xQnix) — Qn+i{x) + a„-pQn~p{x) with arbitrary p > 1 and a„ > for all n. The recursion 
is encoded by a two-diagonal Hessenberg operator H. One of our main results is that, 
for periodic coefficients a„ and under certain conditions, the Qn are multiple orthogonal 
polynomials with respect to a Nikishin system of orthogonality measures supported on star- 
like sets in the complex plane. This improves a recent result of Aptekarev-Kalyagin-Saff 
where a formal connection with Nikishin systems was obtained in the case when X^J^q \an — 
a| < oo for some a > 0. 

An important tool in this paper is the study of 'Riemann-Hilbert minors', or equivalently, 
the 'generalized eigenvalues' of the Hessenberg matrix H. We prove interlacing relations for 
the generalized eigenvalues by using totally positive matrices. In the case of asymptotically 
periodic coefficients a„, we find weak and ratio asymptotics for the Riemann-Hilbert minors 
and we obtain a connection with a vector equilibrium problem. We anticipate that in the 
future, the study of Riemann-Hilbert minors may prove useful for more general classes of 
multiple orthogonal polynomials. 

Keywords: Multiple orthogonal polynomial, Nikishin system, banded Hessenberg ma- 
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1 Introduction 

Let (Qn)J^o be the sequence of monic polynomials generated by the recurrence relation 

xQn{x) = Qn+lix) + an-pQn-pix), n > 0, (1.1) 

for a fixed integer p E N :~ {1, 2, 3, . . .}, with initial conditions 

Qoix) = l, Q_i(x) = •■• = g_p(a:) =0. (1.2) 

The recurrence coefficients a„ are assumed to be positive real numbers: 

a„>0, n>0. (1.3) 

Note that for p — 1, (jl.ip reduces to the standard three-term recurrence relation for orthogonal 
polynomials on the real line, in the special case of an even orthogonality measure. We will be 
interested in the case where p > 2, which we refer to as a high order three-term recurrence [T]. 

The assumption (|1.3p implies that the zeros of Qn are located on the star S+ := {a; G C | 
xP^^ E I^+Ij and that they satisfy certain interlacing relations. This was demonstrated by 
Eiermann-Varga [T2j and Romdhane [24]; see also Fig. [1] and [2] below for the case p = 2. In 
the present paper we will obtain more general interlacing relations, in the context of so-called 
Riemann-Hilbert minors. 

The polynomials Qn are studied in the literature under various assumptions on the recur- 
rence coefficients a„. He and SafF [16j show that the Faber polynomials associated with the 
closed domain bounded by a (p-f l)-cusped hypocycloid satisfy the recursion (jl.ip with constant 
coefficients a„ = a = l/p. Many properties of these Faber polynomials are obtained in [TH [H] . 
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More properties and applications for the polynomials Qn are obtained by Ben Cheikh-Douak 
[3], Douak-Maroni [9j, Maroni [20] and others [351 121] ■ The polynomials Qn are often called 
d- symmetric d- orthogonal polynomials in these references (with d :— p). An application from the 
normal matrix model is given in [5]. 

General considerations [101 117] show that the polynomials Qn satisfy formal multiple orthogo- 
nality relations with respect to certain linear functionals. Aptekarev, Kalyagin and Van Iseghem 
[2] obtain a stronger version of this result: 

Theorem 1.1. (See jj^ Th. 1.1], Cor. 2]:) Suppose that a„ > for all n and the numbers 
an are uniformly bounded. Then the polynomials Qn{x) are multiple orthogonal with respect to 
the measures vi, . . . ^Vp defined in (j8.3p ( see Section in the sense that 



(1.4) 



for any m G [0 : [-^^-^J] and j £ [1 : p 



Here x M- [a;J denotes the 'floor' fmiction and we abbreviate [i : j] :~ {z, i + 1, . . . , j}. This 
notation will be used throughout the paper. 

The measures vi, . . . ,Vp are supported on a compact subset of the star 5+. We will call them 
the orthogonality measures. Aptekarev, Kalyagin and Saff 1; study these measures in the case 
where X^J^o 1*^" — a| < oo for some a > 0. They obtain a formal link with Nikishin systems. In 
the present paper we will extend this link to the case of periodic a„. In particular, we will obtain 
conditions guaranteeing that i^i , . . . , i/p form a true, rather than a formal, Nikishin system. 



For any j G [1 : p] , define the second kind function ^n"^ 



by 

n > 0. 



(1.5) 



Define the Riemann-Hilbert matrix (briefly RH matrix) Yn{z) by 



Yn{z) 



( Qn{z) 
}n-l{z) 



■^\^\z) 



\Qn-p{z) *W^(z) 



^^^\z)\ 

^^:Uz) 



(1.6) 



This definition is a variant of the one in Van Assche, Geronimo and Kuijlaars [55] , see also [IB] 
The matrix Yn{z) satisfies a certain Riemann-Hilbert problem; but we will not need this here. 
Denote the principal (fc + 1) x (fc + 1) minor of Yn{z) by 

/ Quiz) MP{Z) . 



Bk.n{z) = det 



(fc) 



{z)\ 



\Qn-k{z) *Wfe(^) 



(fc) 
n — k 



(1.7) 



{z)l 



for fc g [0 : p]. We call this the kth principal Riemann-Hilbert minor of Yn. For n < k we set 
Bk.n{z) = 1. In this paper we will also work with the determinants of more general submatrices 
of (II. 6p . whose rows are not necessarily consecutive; see Section [3] and following. 

Lemma 1.2. For any fc e [0 : p], Bk.nix) is a polynomial of degree 



degBk,n < 



-{n — k). 
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Proof. First we prove that Bk^n{x) is a polynomial. By the multi- linearity of the determinant, 



/ Qn{z) Qniyi) ■■■ QniVk) 

Bk,n{z) ^ j "' j '^^^ '■ '■ '■ 

\Qn-k{z) Qn-kiVl) ■■■ Qn-k[Vk)j 



dvi{yi) . . . AvkiUk) 
{z~yi)---{z- yk)' 



The integrand is clearly a polynomial in z, hence Bk^n is a polynomial. Finally, the claim about 
the degree of Bk.n{z) will be a consequence of Prop. [^751 and Lemma [2.51 in what follows. (This 
claim may be shown in a direct way as well.) □ 

Note in particular that degi?p.„ = 0, i.e., the determinant of the full RH matrix Yn{z) is a 
constant. Prop. [^751 will imply that this constant is nonzero. 
Define the two complementary 'stars' 

5± ;= {x e C I xP+^ e R±}. (1.8) 

In this paper we will prove that the zeros of B^.n (and of more general RH minors) are all located 
on the star S+ if k is even and on the star S- if k is odd. We will also obtain several kinds of 
interlacing relations between the zeros of the different RH minors. 



The main focus of this paper is on the case where the recurrence coefhcients a„ are asymp- 
totically periodic of period r gN. This means that 

lim a™+, =: 6, > 0, je[0:r-l], (1.9) 

n— >oo 

for certain limiting values bo, ... , W-i > 0. 

It turns out that in the asymptotically periodic case, the zeros of Qn for n — >■ cx) are attracted 
(in the sense of weak convergence) by a certain rotationally invariant subset Fg of the star 5*+. 
Moreover, the zeros asymptotically distribute themselves according to a measure fiQ on Fg, which 
appears in the solution to a certain vector equilibrium problem. An example of the set Fg is 
shown in the left picture of Fig.[TJ Below we will also introduce a family of sets Ffc and measures 
/Ltfc, fc € [0 : p — 1], which will be the limiting zero distributions of the RH minors Bk.n. 

Define the matrix 

F{z,x) := Z-^ + ZP diag{bo, ... ,br-i) - xir, (1.10) 

and the algebraic curve 

^ f{z,x) := dctF{z,x), (1.11) 
where Z denotes the cyclic shift matrix 




(1.12) 



and where Ik denotes the identity matrix of size k. If r = 1 then we put Z = z and bo =: b. In 
that case, (II. lip reduces to the algebraic curve z~^ + bz^ — a; = in [TJ[T6]. The matrix F{z, x) 
can be interpreted as the symbol of a block Toeplitz matrix. This is explained in Section [6] 
The expression f(z,x) can be expanded as a Laurent polynomial in z: 

fiz, x) = {-ly-^z-^ + fo{x) + hix)z + ■■■+ fpix)zP, (1.13) 
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Figure 1: Zeros of Qgo (left) and Pi, so (right) in the periodic case with p — 2 and period r ~ 8 
and (ao,...,a7) — (3,1,5,2,2,9,6,1). The zeros of Qn accumulate on a set Fq C S+ whose 
intersection with R is [0, 0.85] U [1.52, 2.19] U [2.67, 2.89] (using two digits of precision). The zeros 
of Pi_„ accumulate on a set Fi C S- whose intersection with M is [—3.72,-1.59] U [—0.17,0]. 
Note that Qsq has an isolated zero between some of the intervals. 



where each fkix), A: G [0 : p], is a polynomial in x, and 



r-l 



fp(x)^f,=(-i)f('-p)nfefe- (1-14) 

k=0 

The algebraic equation /(z, x) = has precisely p + 1 roots Zk = Zk{x), k & [0 : p] (counting 
multiplicities), and we order them by increasing modulus as 

\zo{x)\ < \zi{x)\ <■■■< \zp{x)\ (1.15) 

for all x e C. If a; e C is such that two or more subsequent roots Zk{x) in (|1.15p have the same 
modulus then we may arbitrarily label them so that (|1.15p is satisfied. It is easy to see (see e.g. 
[3 Sec. 4] or [13 P- 102]) that for x oo, 

zo{x) = x-''- + Oix-'-^), Zfe(x) = 0(x'^/f), kG[l:p]. (1.16) 

More precisely, for any a; G C there is a permutation {zkix))^^i of the set izkix))^^i so that 

/r/d-l \ 

2'fe(a;)P/''= ( n W(fc-imodd) 1 x'-/'^(l + o(l)), fce[l:p], (1.17) 

as X -7- oo, where d := gcd{p, r}. See [221 p. 102]. 
Define the sets F^ by 

Tk = {xeC\\zkix)\^\zk+i{x)\}, ke[0:p-l]. (1.18) 



It turns out that F^ is a finite union of line segments on the star S+ if k is even and S- if k is 
odd: see Fig. [T] and Theorem 12.21 The next lemma shows that F^ is rotationally invariant. 



Lemma 1.3. (Rotational symmetry:) Withuj := exp(27ri/(p+l)), we have f{z, lux) = uj^ f (uj^ z , x) 
Hence, for any a; G C the sets {zk{uJx))'^^Q and are equal up to permutation, and 

each set Tk is invariant under rotations over 2tt / {p + 1). 

Proof. Recalling (jl.l0p - (jl.l2p . it is easy to see that D^^F{z,iox)D — ujF{uj^z,x) where D := 
diag(l,w,w^, . . . ,u!^~^). This implies the lemma. □ 

For any k E [0 : p — 1], define the measure 

1 1 ^ fz'{\) z' (A)\ 
dA'fc(A) = 7r--yM^-^4TT (1-19) 

supported on F^. Here the prime denotes the derivative with respect to A, and dA denotes 
the complex line element on each line segment of F^, according to some fixed orientation of 
Tk- Moreover, Zj+{X) and Zj_(X) are the boundary values of Zj(X) obtained from the +-side 
and — side respectively of F^, where the +-side ( — side) is the side that lies on the left (right) 
when moving through Ffe according to its orientation. It turns out that /ifc is a positive measure 
(obviously independent of the orientation given to F^) with total mass Sec. 4] 

/ifc(rfc) = ^— ^, ke[0:p-l]. (1.20) 

p 

The measures {fik)k are the minimizers to an equilibrium problem that we now describe. For 
any measures /u, ^ on C define their mutual logarithmic energy as 

^(m, t^) = / / log-p— — T dA*(a;) di^iy)- 
JJ \x-y\ 

The logarithmic energy of the measure fi is defined as /(/i) — fJ.). 

We call a vector of positive measures j7 = (fo, . . . , t'p-i) admissible if Vk has finite logarithmic 
energy, Vk is supported on F^, and has total mass Vki^k) = k G [0 : p — 1]. The energy 
functional J is defined by 

p-l p-2 

J(i7) =^/(i.fc)-^/(i.,,i.,+i). (1.21) 

k=Q k=a 

The (vector) equilibrium problem is to minimize the energy functional (jl.21l) over all admissible 
vectors of positive measures i7. The equilibrium problem has a unique solution which is given by 
the measures fik in (|1.19p . see [7]. 



2 Statement of results 

2.1 Limiting zero distribution of Riemann-Hilbert minors 

Denote the normalized zero counting measure of Bk.n, A: G [0 : p — 1], by 

Mfc.n := - ^x, (2.1) 

x\Bk.,^{x} = a 

where is the Dirac measure at x and each zero is counted according to its multiplicity. 
Lemma 11.21 shows that fik,n has total mass at most {p — k) /p. Now we state our first main 
theorem. 
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Theorem 2.1. Assume we have asymptotically periodic recurrence coefficients p.9p . and define 
IJ-k,n, /ifc 0.S in (|2.ip and (|1.19l) . T/ien /or ony fc S [0 : p — 1], i/ie measures ii,k,n weakly converge 
to the measure /ife on Ffe as n oo. This means that 

lim / 0(x) d/ifc,„(x) = (t){x)dnk{x) (2.2) 



/or HTiy bounded continuous function (j). 

Theorem 12.11 will be proved in Section [7] with the help of a 'normal family' estimate for the 
ratio of two RH minors (Section [SJ , and using the generalized Poincare theorem. In fact, we will 
use a multi-column version of the generalized Poincare theorem (Lemma 17.21) . This approach 
yields not only weak asymptotics but also ratio asymptotics for the RH minors, as we explain in 
Section [71 see e.g. (fr23| or (fTM)) . Moreover, we will see that Theorem 12.11 remains valid with 
Bk,n replaced by more general RH minors (Remark 17. 7p . 

We point out that Theorem 12.11 for fc = could also be obtained from the normal family 
arguments in taking into account the interlacing relations for the zeros of Qn- 

Theorem 12.11 shows that the limiting zero distribution of each Riemann-Hilbert minor B^^n 
exists and that the limiting measures are the minimizers to a vector equilibrium problem. We 
have reason to believe that a similar conclusion may hold for more general classes of multiple 
orthogonal polynomials. This may be an interesting topic for further research. 

2.2 Star-like structure of 

Theorem 2.2. Assume that (|1.9I) holds. Fix k G [0 : p — 1] and define Ffe (11.181) and also 

Tfc = 1 := {xP+' I X e Ffe}. (2.3) 

Then: 

(a) Tk is part o/R+ ('or R_j if k is even (or odd respectively), 
(h) Ffc is the union of intervals Ij^k- 



Pfc = IJ IjM, with rife 





-1 " 

— r 

- 1 




kr 






_ P _ 



(2.4) 



with X I—)- \x~\ and X H- [xj denoting the 'ceiling' and 'floor' functions. The intervals Ij^u, 
/ G [1 : rife] are pairwise disjoint except maybe for common endpoints. 

(c) The following conditions imply that Ffe contains or oo." 

r^N^OGFfc, — ^NU{0}^(-l)'^ooGFfe. (2.5) 



p + 1 p 



Theorem 12.21 was formulated for the sets F^ in (12. 3p . In terms of the original sets F^, it 
implies that Ffe lies on one of the two stars 5'+ and in (jl.Sp , depending on whether k is even 
or odd respectively. Recall that Ffe is rotationally invariant (Lemma 11.31) . 

Theorem 12.21 will be proved in Section 17.31 In the case r = 1 it was already obtained by 
Aptekarev-Kalyagin-Saff [T]; note that in that case we have no = • ■ • = rip_i = 1, Fq = [0,c] for 
a certain c > 0, and Ffe = (-1)''M+ for fc G [1 : p - 1]. 
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Remark 2.3. As mentioned in the statement of the theorem, the intervals Ij^k, j (z [1 : Uk] in 
(j2.4p are pairwise disjoint except possibly for common endpoints. We believe that such common 
endpoints are rare, in the sense that for a sufficiently 'generic' choice of the parameters bk > 0, 
fc G [0 : r — 1], all the endpoints of the intervals are distinct. 

Remark 2.4. Suppose p = 2. Then we have two values fc = and k — 1, and (j2.4p reduces to 



riQ = 



"r ■ 




"2r" 




r 




ni = 








3 


y 




.2. 



For example, if the period r = 6 then wc have tiq = 2 and ni = 1. Note that this is the same 
setting as in '191, but in the latter paper there is an additional structure on the bk > which 
implies that the two intervals of Tq are tangent (and contain the origin), so that Tq consists of a 
single contiguous interval in that case. If the period r = 8 then we have uq — 3 and ni = 2: see 

Fig.m 



2.3 Generalized eigenvalues and interlacing 



To obtain interlacing relations for the zeros of RH minors, we will use an alternative representa- 
tion via generalized eigenvalue determinants that we now describe. To the recurrence (jl.ip we 
associate the Hessenberg operator H = {Hij)°°^Q with entries 



H. 



j+p-j 



H, 



J, J>0, 
otherwise. 



(2.6) 



We refer to 77 as a two- diagonal Hessenberg matrix. We denote with Hn its n x n leading principal 
submatrix: 

/O 1 0\ 



n-l 



ao 



(2.7) 



V an-v-l ■ ■ ■ 0/ 

The recurrence relation (jl.ip can be written in matrix- vector form as 

xiQoix),Qiix), ...f^ H{Qo{x),Q^{x), . . .)^, (2.8) 

where the superscript denotes the transpose. This implies easily that Qn{x) ~ dct{xln — Hn). 
So the eigenvalues of iJ„ are the zeros of Q„. 

For fc S [0 : p] we define the polynomial Pfe_„(a;) as the determinant of the submatrix of 
Hn — xin obtained by skipping the first k rows and the last k columns. Thus 



Pk,n{x) = det 



ao 



(2.9) 



(n — k) X (n—k) 
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The fcth generalized eigenvalues of _ff„ are the numbers x £ C such that Pk.n{x) — 0. For n < k 
we set Pk,n(x) = 1. Note that for fc = p we have Pp^n{x) = uq ■ ■ ■ a„_p_i > 0. 

Lemma 2.5. For any fc G [0 : p], the polynomial Pk.n{x) has degree 

degPfe,„ < - — -{n - k). 
P 

Proof. This follows by a simple combinatorial argument; see e.g. [Ill Proof of Prop. 2.5]. □ 

Lemma 12.51 could be refined using the combinatorial formulas in Section [5] This leads to an 
exact formula for degPfc^„, depending on n mod p. We will not go into this issue here. 
The fact of the matter is the following. 

Proposition 2.6. (Generalized eigenvalues versus RH minors:) For any fc G [0 : p], 

BkA^) = (-l)"("+^)-('^')cfePfc,„(x), (2.10) 
cf. (jl.7p , where the constant Ck depends only on the first k moments of the measures vi, . . . ^Vk- 



Ck = {-!)' 



dui{t) 



Ql{t) dv2[t) 



Qk-i{t) dvk{t) 



(2.11) 



Note that in (I2.10p and (j2.1ip . we should understand (2) = and cq = 1. 
We point out that Prop. 12.61 remains valid for arbitrary banded Hessenberg operators, that 
is, for matrices H = {Hij)°°^Q defined by 



H,-i.j =1, j> 1, 

H,+k^,^af\ i>0, fee [0:p], af^ 



(2.12) 



Hi 



0, 



otherwise, 



so that 



Hn = {H, 



ri-l 



,(p) 



V 



\ 



a. 



(p) 

'n—p-—l 



(2.13) 



4"2r/ 



We will assume that a^^-* 0, for all j, so the entries on the pth subdiagonal of (j2.13p are non- 
zero. We associate to H the sequence of monic polynomials {Qn)^=Q satisfying the {p + 2)-term 
recurrence relation (|2.8p . i.e.. 



xQn{x) = Q„+i(x) + all'>Qn{x) + alllj^Qn-iix) H 1- a^flpQn-pix), 

with initial conditions 



Ap) 



n > 0, (2.14) 



Q-i 



Q_p = 0, Qo^l. 



(2.15) 

Prop. [121 will be a consequence of a result proved in Prop. [XTI for the polynomials Qn satisfying 
(|2.14p - (|2.15p . assuming that these polynomials are multiple orthogonal with respect to a system 
of p measures, see Section [3] for more details. 

Prop. 12.61 shows that RH minors can be alternatively represented as generalized eigenvalue 
determinants. We now state interlacing relations for the latter. 
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Figure 2: Left picture: zeros of (323 (circles) and Q24 (squares). Right picture: zeros of Q2i 
(squares) and Q27 (circles). In these pictures we have a two-diagonal Hessenberg matrix H 
as in (|2.6p - (|2.7p with p — 2 and recurrence coefficients (ao, . . . , 05) ~ (3, 2, 3, 5, 4, 1) extended 
periodically with periodicity r = 6. 

Theorem 2.7. (Interlacing for generalized eigenvalues:) Let H be a two-diagonal Hessenberg 
matrix (j2.6p with aj > for all j . Fix n G N and /c G [0 : p — 1] . Then 

(a) We have Pk.n{x) ~ x™''-" Pk,nix^~^^) , for a polynomial Pk.n with Pk,n(f^) 7^ and with 



The zeros of Pk^n o-li Us in (^-) if k is even (odd). 

(b) Denote the zeros of Pk^n o,nd Pk^n+i os (a;i)i=i,2.... o.nd {yi)i=i.2,... respectively, counting 
multiplicities and ordered by increasing modulus. We have the weak interlacing relation 



if n = j mod (p + 1), j G [— 1 : fc — 1]. 

(c) Let {xi)i=i^2,... be the zeros of Pk,n, as in (b), and let (10^)^=1 2,... be the zeros of Pk^n+p+i, 
counting multiplicities and ordered by increasing modulus. We have 

< \wi\ < \xi\ < \W2\ < \X2\ < .... 

Note that the moduli can be removed if k is even and replaced by minus signs if k is odd. 

Theorem 12.71 generalizes known results for the standard eigenvalues fc = |12[ [53] . The 
theorem will be proved in Section^ by using the theory of totally positive matrices and extending 
the approach of Eiermann-Varga ^24. See also Theorems 12.121 and 14.61 below for related results. 

Theorem 12. 71 is illustrated in Figures [2] and [3l 

Generalized eigenvalues turn out to be deeply connected to the hierarchy of functions of the 
(formal) Nikishin system generated by H. This will be the topic of Section [2.41 




(j-fc)(fc + l), ifn = j mod {p+1), j e[k -.p], 
{k-j){p-k), ifn = j mod (p+l), j e [-1 : k 



(2.16) 



< \xi\ < \yi\ < \X2\ < I2/2I < •■• 



ifn 



j mod (p + 1), j G [A: : J3 — 1], and 



< \yi\ < \xi\ < \y2\ < \x2\ < ... 
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Figure 3: Left picture: zeros of Pi, 23 (circles) and Pi, 24 (squares). Right picture: zeros of Pi, 24 
(squares) and Pi, 27 (circles). The matrix H is as in Figure [2] 



2.4 Connection with Nikishin systems 

Aptekarev-Kalyagin-Saff [1 show that, in the trace class X^feLo I'^fe ~ ^1 < ^ ^^'^ with period 
r = 1, the two-diagonal operator H generates a (formal) Nikishin system. These objects are only 
formally defined however. 

In this paper we will obtain a related result. It will apply to the exactly periodic case 

flrn+fc = flfe &fe, neN, A:G[0:r-l]. (2.17) 

We assume without loss of generality that the period r is a multiple of p. We also assume that 

r/p~l r/p~l 

Y[ O'pn > Y\. > ■ ■ ■ > Y\. "pn+(p-l)- (2-18) 

n— n— n— 

Under these conditions, we will show that the polynomials Qn are multiple orthogonal with 
respect to a true Nikishin system generated by rotationally invariant measures on the stars 5*+ 
and S-, coming from measures on R+ or M_ with constant sign. There can also be possible 
point masses at each level of the Nikishin hierarchy. 

Nikishin systems formed by measures supported on the real line were introduced by E.M. 
Nikishin in [23]. The same definition can be easily adapted to our context of star-like sets, as we 
now explain. Compare this definition with the one given in (TJ Section 8.1]. 

Definition 2.8. Let i'i,...,h'p be a collection of p complex measures supported on the set 
Fq U where C 5*+ \ Fq is a discrete set. We say that (i^i, . . . , i^p) forms a Nikishin 
system on (Fq, . . . , Fp_i) if for each fc G [0 : p — 1], there exists a collection of complex measures 
(^',fc)f=fc+i supported on TkUAk, where Ak is a discrete subset of S+\Tk (if k is even) or S- \Tk 
(if k is odd), with the following properties: 

(a) (i^i, . . . , i/p) = (i^i,o, . . . ,fp,o)- 

(b) If dvi,k{x) ~ 9i,k{x) dx + dii\^^{x)^ (lv\''^{x) _L gi^k{x) dx, denotes the Lebesgue decompo- 
sition of vi^k, I ^ [k -\- 1 : p], then 

gi,k{x) f dz/;,fc+i(t) 



gk+i,k{x) 



j '^"'^"lf\ XGF,, l^[k + 2:p]. (2.19) 
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(c) For every Z G [fc + 1 : p], there exists a real measure vi^k with constant sign (either positive 
or negative), supported on M+ (K-) if k is even (odd), such that 



k+l-l 



(2.20) 



Remark 2.9. We observe that Nikishin systems possess a hierarchical structure, with the measures 
{vi, . . . , Vp) forming level of the hierarchy. The measure vi^k is said to be at the kth level of the 
Nikishin hierarchy. Note that (|2.20p implies that for any /c 6 [0 : p — 1], the measure Vk+i,k is 
rotationally invariant, and the induced measure i>k+i,k is real with constant sign. The measures 
Vk+ijk are usually referred to as the generating measures of the Nikishin system. We are implicitly 
requiring in (|2.19p that gk+i^k{x) / for all but finitely many x G Tk- 

Our main result is the following. 

Theorem 2.10. Let H be a two-diagonal Hessenberg matrix (j2.6p with exactly periodic coeffi- 
cients aj > satisfying (j2.17p - (|2.18l) . where the period r is a multiple of p. Then the orthogonal- 
ity measures {vi , . . . , Vp) in Theorem form a Nikishin system on (Fq, . . . , Fp-i) (Def.\K^. 
Moreover, the star-like sets (F/-)^~|!) are compact and the discrete sets {Ak)k=Q are finite. 

Theorem 12.101 will be proved in Section |51 
Remark 2.11. Theorem 12.101 was stated under the condition (|2.18p . In general, consider the set 



for X oo. This can also be seen from the derivation of (|8.26l) in Section [5] As a consequence, 
if the p numbers in (j2.2ip are pairwise distinct then all the F^ are bounded. The converse of 
the last statement is also true, due to [221 Lemma 3.3]. Now if the numbers (j2.2ip are pairwise 
distinct but ordered in a different way than (j2.18p . then a variant to Theorem 12.101 holds. We 
then have an additional constant or monomial term in the right hand side of (12.191) . This is due 
to the fact that the constant a in Eq. (|8.19l) in Section |S] can be nonzero in this case. 

We see that the key to obtaining a true (rather than a formal) Nikishin system is to show 
that the ratio between the densities (|2.19p of the measures at the different levels of the Nikishin 
hierarchy are Cauchy transforms of measures on 5+ or S*-, associated to real measures with 
constant sign on R+ or R_. We will establish this requirement via a surprising connection with 
RH minors. In particular we will use the interlacing relations between the zeros of RH minors. 

Recall the generalized eigenvalue determinant Pk,n{x) from (12.91) . We need a more general 
definition. For any 1 < k < I < p we define Pk,i.n{x) as the determinant of the submatrix 
obtained by skipping rows 0, 1, . . . , fc — 1 and columns n — — fc + l,n — fc + 2,...,n — 1 of 
Hn — xin. li I — k then we retrieve our previous definition: Pk,k,n{x) = Pk,n{x). 

In the proof of Theorem 12. 101 we need the following result on the polynomials Pk,i.n{x). 

Theorem 2.12. (Interlacing for Pk,i.n o,nd Pk.n-) Let H be a two-diagonal Hessenberg ma- 
trix (12.61) with Oj > for all j . Fix n £ N and < k < I < p. Then 




(2.21) 



Eq. (|1.17p (with d = p) shows that there exists a permutation 11 of [1 : p] so that 




(2.22) 
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(a) We have Pk,i,n{x) — Pk,i,n{x^^^) , with mk,n defined in (|2.16p and with Pk,i,n a 

polynomial whose zeros all lie in R+ (M-^ if k is even (odd). 

(h) Denote the zeros oj Pk,n{x) and Pk^i.n{x) as {xi)i=i^2.... o,nd {yi)i^i^2.... respectively, ordered 
by increasing modulus and counting multiplicities. We have the weak interlacing relation 

0<\yi\ < \xi\ < \y2\ < \x2\ < .... 

Theorem l2.12l is proved in Section |4l The precise way how Theoreni l2.12l is used in the proof 
of Theorem 12.101 wih be explained in Section [8] 

Remark 2.13. The polynomial Pk,i,n could have one, and at most one, zero at the origin. This 
happens precisely when n = j mod (p + 1) for some j G [k : I — 1]. 

2.5 Widom-type formula 

In this section we state an exact formula for the polynomials Qn in the exactly periodic case (|2.17l) . 
In fact, we prove the formula for general banded Hessenberg matrices H of the form (I2.12p . We 
say that H is exactly periodic with period r if 



^rn+k ^ ^k ~ "k 



^bX', 71 e N, fc e [0 : r - 1], j G [0 : p\. (2.23) 



Recall that we are assuming b'^j^^ ^ for all k. Define the 'block Toeplitz symbol' 

p 

F{z, x) = Z-^+Y, diag(5^'=\ . . . , }^^\) - xU, (2.24) 

k=0 



with Z as in p.l2p . In the case of a two-diagonal Hessenberg matrix (j2.6p this reduces to p.lO|l . 
Also define f{z,x) = detF(z,a;), the roots Zk{x) of the algebraic equation f{z,x) = as in 
(|1.15p . and the sets Ffc as in (ll.lSp . Prop. 1.1 in [7 shows that Ffc is a finite union of analytic 
arcs. Clearly, (|1.13p -- (jl.l4p remain valid in this setting (with bk replaced by b^^'')- 

Theorem 2.14. (Widom-type formula:) With the above notations, let x lE C be such that the 
solutions Zk{x) of the algebraic equation — f{z,x) = AeiF[z,x) are pairwise distinct. Then 
for each n G N U {0} and for each j £ [0 : r — 1], 



k=0 



Ui=Q,^=^ki'^k{x) - Z,{x)) 



Here fp is defined in p.l4p (with b^ replaced by b^^^ ), and we use the notation F"^'^ to denote the 
submatrix of F in (j2.24p that is obtained by skipping the ith row and the jth column, i,j G [0 : 
r — 1] . Moreover, for all i, j, k, det {zk{x), x) is zero for only finitely many x. 

Theorem 1 2 . 1 41 will be proved in Section [51 as a consequence of Widom's determinant identity 
for block Toeplitz matrices [33 Section 6]. From (I^T^ and pTT5|) - pTT51) we also find: 

Corollary 2.15. The strong asymptotic formula 

V n ^ W \n+i i-^y^' dctF-^-^{zo{x),x) 

hm Qrn+j{x)zo{x) + = — , J G p : r - 1 , 

n^oo fp YYLliMx) - Z^{x)) 

holds uniformly on compact subsets of C\ (Fq U A) with A a finite set. 

Incidentally, Aptekarev et al. [11 obtain strong asymptotics for Q„ in the trace class X)fe°=o Wk — 
a| < oo (a > 0) with period r ~ 1. By using Theorem 12. 14[ it is possible to extend these results 
to higher periods r. We will not go into this issue here. 
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2.6 Outline of the paper 



The rest of this paper is organized as fohows. In Section [3] we prove the connection between RH 
minors and generahzed eigenvalue determinants and we introduce the concept of a general RH 
minor -"'=)(2). InSectionH we prove interlacing relations for generalized eigenvalues. 

Section [S] contains normal family estimates for the ratio between two RH minors. The remaining 
sections deal with asymptotically periodic coefficients a„. The proof of the Widom-type formula 
for Qn in the exactly periodic case is given in Section [HI In Section [7] we obtain weak and 
ratio asymptotics for RH minors and we prove Theorem 12.21 on the star-like structure of . In 
Section [8] we prove Theorem 12. 101 on the connection with Nikishin systems. 



3 Riemann-Hilbert minors and generalized eigenvalues 



In this section we prove Prop. 12.61 in the general context of banded Hessenberg operators H = 
iHij)f°j^o defined in (l2T2ll . 

Let (Qn)^o t>e the sequence of monic polynomials associated to the operator H, i.e., the 
sequence satisfying (j2.14p - (|2.15p . We will assume in this section that the polynomials Qn are 
multiple orthogonal with respect to a system of p complex measures vi, . . . supported on a 
compact contour S C C. This means that for every j € [1 '■ p], 



Q„(t)t'"dt/j(<) = 0, me[0 



(3.1) 



Define the second kind functions as in (jl.5D . 

For later use, we need a more general definition of generalized eigenvalues. Let Hn = 
iHij)^~lQ. As in (j2.9p . we denote by Pfc.„(x) the determinant of the matrix obtained by skipping 
the first k rows and the last k columns of the matrix Hn — xin ■ Similarly we could skip any set 
of k different columns, not necessarily consecutive. 

Let k G [0 : p] and let (no, ni, . . . , Uk) be a (fc + l)-tuple of positive integers such that 

< no < ni < . . . < Uk < no + p. (3-2) 
We define the generalized eigenvalue determinant associated to (no,ni, . . . ,nk) as 

p(„o,ni,...,n.)(2.) det(i7„, - ^j^j(0,l,....fc-l;no,ni,...,nfc-l)_ (3 3) 

That is, the polynomial p("0'"i'- -^"fc)(a;) is the determinant of the submatrix obtained by skipping 
rows 0, 1, . . . , fc — 1 and columns no, ni, . . . , rik-i of H„^ — 2;/„j, . The generalized eigenvalues 
associated to (no,ni, . . . ,nfe) are the numbers a; £ C such that pi^^o,ni,...,nk) ^^-^ _ ^^le case 
fc = we put n :— no and we understand P'^^^x) — det(_ff„ — x/„) — (— l)"(3n(x). 
By choosing (no, ni, . . . , n^) to be a sequence of consecutive numbers: 

(no,ni, . . . ,nfc) = (n - fc, . . . ,n - l,n), 

we retrieve our earlier definition p("-'=.- -^"-i'")(x) = Pk.n{x). Similarly we can retrieve Pk,i,n{x). 
In this section we prove the following connection with Riemann-Hilbert minors. 

Proposition 3.1. Let H = {Hi^j)°°^^^ be the banded Hessenberg matrix (I2.12p with a'j'^ ^ for 
all j > 0. Assume that the monic polynomials (Qn)^o P-14l) - (|2.15p associated with H satisfy 
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the multiple orthogonality relations (|3.ip , for some complex measures vi, . . . supported on 
S C C. Let be the second kind functions (jl.Sp . For any k ^ [Q : p\, we have 



where 







^(no,ni,...,nfc) 












\Qna{z) 




... ^^^hz) 

... 



(3.4) 



(3.5) 



and where the constant Ck is given in (j2.1ip . 

The matrix in the right hand side of p. 51) is again a submatrix of the RH matrix in 
(with n = Uk), although not necessarily a principal submatrix. This follows from 



Proof of Prop. \3.1[ We prove (|3.4p by verifying that both sides of the equation satisfy the same 
recurrence relation. Assume that > fc + 1. If we apply the cofactor expansion formula to 
jj(no,ni,- -,nfc) ^^•j along the last row, we obtain 



P 



{no,ni,...,nk) ( \ _ 



p+1 



(z) = ^(-1)'^^- (i/„, - z/„ J„,_i,„,_, P^"--"—- (z), 



(3.6) 



where in the right hand side of 
is defined in the following way: 



Aij denotes the {i,j) entry of a matrix A, the function P 



p(So,ni,...,nfc) j-^-j 





if Uk- j ^ {no, . . . ,nfc_i}, 
otherwise, 



where {uq, fii, . . . , n^) is obtained by ordering the entries of (no, . . . , nfc_i, n^, — j) increasingly, 
and where aj is the sum of the row and column coordinates of the entry (Hn,. — z/„j.)„^_i_„^_j 
in the matrix (Hn^. — 2:/„j.)*^'''^' "''^^^'"'''"i' - '"''-i-' (the definition of aj is used only when Uk^ j 
{no, . . . , nk^i}). We also put (Hn^ - zln^)i,j ■= whenever j < 0. 

To prove ((3T6l) we observe that the submatrix of (ff„^ _ ^/^ j(04,---,fe-i:no,ni,...,nfc-i) obtained 
by skipping the row and column occupied by the entry (iJu^ — zln^)n^^i^n^^j, takes the form 

(ilK, -z/f;J(o,i,-,fe-i;"o,Hi,.. 
* L 

where L is a lower triangular square matrix of size — 1 — with I's on the main diagonal. 
Hence the determinant of this submatrix equals p("0'"i'- -'"'=)(z)j which yields p.6p . 

Note that the recursion p.6p is completely determined from its initial condition (determinant 
of an empty matrix) 

P^^^^'-^\z) = l. (3.7) 

It is well-known (and easily checked) that the second kind functions "^[v' satisfy exactly the 
same recursion as the polynomials Qn , in the sense that 



x*W(z) = vl,W^(,) + a(°)vl/W(^) + a^2,^^:iAz) + ■■■ + ai':!^*i'^,(z), n>k, (3.8) 
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for any k & [1 : p\. The recursion for the functions starts only from the index n = k. 

Assume that Uk > k + 1. Applying (j2.14p and (13.81) (with n :— Uk — I) to the first row of p.Sp 
and using the linearity of the determinant, we deduce that 



P+i 



where 



^(no,...,Tifc_i,ri)j-j) j-^-j 







(z) if nfe - j ^ {no,...,nfc_i}, 

otherwise, 



and Tj is the number of adjacent transpositions that are necessary to order (no, . . . , nk-i, rik — j) 
increasingly, e.g. for {hq, n-i, fT.2, "-3 — j) = (1,4, 5, 3) we have Tj = 2. 

If (no, ni, . . . , rife) is obtained by ordering (no, • • • , "-fc-i, "-fc — i) increasingly, then obviously 

no + jii + ■■■ + Uk — {no + ni + ■■■ + Tik) = j- (3.10) 

From and (|XTU|) we have 



Cfe 



^_2y»o+niH hrifc p(no,ni,---,nfe)j'^^ 



p+1 



^(i/„, -z/„J„,_i,„,_,(-l)-^(-l)M-l)"°+"^+-+"'=CfeP(""'"--"'=-^)(z). (3.11) 



We claim that 



(_l)i+-. = (-1)- 



(3.12) 



Let j > 1 and assume that nk-i < nk — j- Then Tj = so the left-hand side of p.l2p is — 1. 
Now, if j is even then aj is odd and vice-versa. So (|3.12p holds in this case. Now let ji be such 
that (— l)^+'^Ji = (— l)'^Ji+Ji and n^ — ji = n/ + 1 for some Z e [0 : fc — 1]. Assume further that 
the next value of j greater than ji for which n^ — j ^ ni for all i is j = ji + g -I- 2, <? > 0. These 
assumptions imply that Tj = Tj^ + g + 1, CTj = ctj^ + 1, and therefore (— 1)^+^ji = (— 1)'^ji+Ji 
implies that (|3.12p is valid for j. This completes the justification of (j3.12p . 

It follows from ([211), (PTT|) and ((XT^ that for each fc, the functions B(»o,ni,...,n,) g^j^^ 
Cfc(— 1)""^"^^ hni p(no,ni,...,nfc) gatisfy the same recurrence relations. The recursion p.9p is 
also completely determined from its initial condition ^^(04. ^ which is 



(Qk[z) *W(z) ... *f(z)\ 



p(o,i,...,fe)(^) ^ det 



VOo(^) <\z) ... 

(z^ + 0{z^-^) 0{z-^) 
0{z''~^) 0{z-^) 



det 



0(z-2) 
0(z-2) 



0(z2) 
0{z) 

V o(i) 



0(z-2) 
0(z-2) 
Ciz-i -f 0(2 



0(z-2) 

C2Z-l+0(z-2) 

O(z-i) 



0(z-2) ^ 
CfeZ-i + 0(z-2 

O(z-i) 
O(z-i) 
O(z-i) / 
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with := J Qj-i(t) dvj{t). Expanding this determinant as a signed sum over all permutations of 
(0, 1, . . . , k), we see that all the terms in this sum are 0{z~^) except for the one that corresponds 
to the permutation (0, fc, . . . , 2, 1): 

^(o,i,...,fe)(^) = (-l)(')CiC2 ...Ck + 0{z-^). 

Since we already know by Lemma 11.21 that the determinant in the left hand side is a polynomial 
in z, the 0{z^^) term in the right hand side vanishes. The value of was chosen so that 

Ck{-lf+^+-+'' P^^^^'-'^^z) ^ B^°'^-'''\z), 

so the two initial conditions are the same and this concludes the proof of (|3.4I) . □ 

4 Interlacing of generalized eigenvalues 

In this section we prove Theorems 12 . 71 and 12 . 121 on the interlacing of generalized eigenvalues. To 
this end we use some results on totally positive matrices. 

4.1 Generalized eigenvalues of totally positive matrices 

A matrix A e C"x™ jg called totally positive (TP) if the determinant of any square submatrix 
of A is positive, i.e., 

detA{K,L)>0, (4.1) 

for any index sets if C [0 : n — 1], L C [0 : m — 1] of the same cardinality \K\ = \L\, where we 
write A{K, L) for the submatrix of A with rows and columns indexed by K and L, respectively. 
We emphasize that in the submatrix A{K,L) the rows and columns are positioned in the same 
order given in A. Fekete 's criterion asserts that a sufficient condition for A to be TP is that (|4.ip 
holds for all index sets K and L formed by consecutive indices, i.e., K = {r,r — 1, . . . ,r — q + 1} 
and L = {c, c — 1, . . . , c — g + 1} with q \K\ — \L\ and for suitable integers r, c. 

The matrix A is called totally nonnegative (TNN) if we have the inequality > in (j4.ip : 

det L) > 0, (4.2) 

for all index sets ii' C [0 : n - 1], L C [0 : to - 1] with \K\ = \L\. It is well known that TP 
matrices are dense in the class of TNN matrices. Moreover, the class of TP (or TNN) matrices 
is closed under matrix multiplication. 

The theory of eigenvalues for TP matrices was developed by Gantmacher-Krein [15j . They 
showed that the eigenvalues of an n x n TP matrix are all positive and distinct and that they 
strictly interlace with those of its principal (rt — l)x(rt — 1) submatrix. We need the following 
analogue for generalized eigenvalues of TP matrices, which are again defined as in Section [2.31 

Proposition 4.1. (Generalized eigenvalues of TP matrices:) Fix < k < n and let M S 

(^(n+k)x(n+k) ^ rpp j^^jy^jj;. Then the kth generalized eigenvalues of M are simple, lie in 
(0, cx)) if k is even and lie in (— oo,0) if k is odd. The number of kth generalized eigenvalues of 
M is n — k. Moreover, the kth generalized eigenvalues of M and its principal leading submatrix 
Q e £{n+k-i)x{n+k-i) strictly interlacing. 

Proof. Let N be the submatrix of M obtained after skipping the first k rows and the last k 
columns of M. Thus N is of size n x n. Partition 
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with C of size k x k. By definition, the kth generalized eigenvahies of M are the numbers x £ C 
such that 

det(^^ (4.4) 

The assumption that M is totaUy positive imphes in particular that all the entries of N are 
positive. We bring to a simpler form by means of elementary row operations. Denote 

r -T Jh^F 

where for j,l G [0 : n — 1], Nj^i denotes the (j, /) entry of N, and where Ejj is the elementary 
matrix of size n x n whose (j, /) entry is 1 and which has all its other entries equal to zero. 
Multiplying N on the left with the matrix Gj amounts to subtracting from row j, Nj^/Nj^i^ 
times row j + 1. This operation eliminates the (j, 0) entry of N . 
We also define 

-^^Ej+k^j+k+i , a j + k + 1 < n, 
otherwise. 




jG[0:n-2], (4.5) 

where we use the same decomposition in blocks as in (j4.3p . 
Consider the transformed matrix 

iV(i) := Gn-2 . . . G.GoNGoG, . . . G„_2. (4.6) 

The matrix iV^^^ has all its entries in the first column equal to zero except for the last one, which 
equals Nn^i^. Let N^^^ be the matrix obtained by removing the first column and the last row 
of iV(i). Using KB, we deduce that the fcth generalized eigenvalues of M are the points x G C 
such that 

'a B - xl^^k 
D 




- 0, (4.7) 




where 

iV(i' = 

with G of size {k ~ 1) x {k — 1). Observe that compared to (|4.4p . the diagonal of x's in (|4.7p is 
closer to the main diagonal. 

We claim that the matrix —N'^^^ is a TP matrix (note the minus sign). For convenience 
we label the rows and columns of 7V'^^ from to n — 2 and from 1 to n — 1, respectively. Let 
K ^ {r,r - I, . . . ,r - q + l] C [0 : n - 2] and L = {c, c - 1, . . . , c - g + 1} C [1 : n - 1] be two 
index sets. From the fact that N is TP we have that 

det N{K U {r + 1}, L U {0}) > 0, 

i.e., the determinant of the enlarged submatrix obtained by adjoining row r + 1 and column to 
N{K, L) is positive. 
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Define 

N ■=Gr...GiGoN. 

It is clear that 

< det N{K U{r + 1},LU {0}) = dct N{K U {r + 1}, L U {0}), (4.8) 

where the last equality follows since the row operations Gq, . . . ,Gr applied to N leave the deter- 
minant invariant. 

From the definition of the row operations Go, . . . ,Gr, the submatrix in the right hand side 
of (|4.8p is zero in its first column except for its last entry. Expanding the determinant along its 
first column we therefore see that 

det N{K U {r + 1}, i U {0}) = {-l^Nr+i^o det N{K, L), 

which combined with (|4.8p and the TP property of N yields 

(-l)'?detiV(i^,i) > 0. (4.9) 

The property (j4.9p remains valid with N replaced by the matrix 

Gn-2 ■ ■ ■ Gr+lN = Gn-2 ■ ■ ■ GiGqN, 

since the row operations G^+i, . . . , Gn-2 applied to N leave the submatrix indexed by rows 
K and columns L invariant. Since K and L are arbitrary index sets, this implies by Fekete's 
criterion that the matrix of size (n — 1) x (n — 1), 

-(G„_2 . . . GiGoN){[0 : n - 2], [1 : n - 1]), 

is TP. This implies in turn that 

-iV(i)([0 : n - 2], [1 : n - 1]) -N'-^'^ 

is also TP, since (cf. (j4.6p ) each of the column operations Go, Gi, . . . , Gn-2 adds to a column 
a positive multiple of the previous column; it is straightforward to verify that such operations 
leave the total positivity of a matrix invariant. 

By repeating the transformation N^^^ := N i-^ N^^^^ k times, we get a series of matrices 
7V(°) ,N'^^\ N'^^') , • • • , A^'-'"'-' so that the fcth generalized eigenvalues of M are the (usual) eigenvalues 
of iV^*^). Moreover, the matrix N'-''^ is TP. One of the assertions of the Gantmacher-Krcin 

theorem implies then the validity of the first statement of the Proposition. 

Finally, if we apply to the leading principal submatrix Q of M the operations described 
above, and denote the resulting series of matrices by Q'-°\ Q'-^\ Q'-^K . . . , Q^^), then Q^^) wih be 
the leading principal submatrix of A^'-'-' for each j G [0 : fc]. In particular, Q''^^ is the leading 
principal submatrix of A^C^') and the Gantmacher-Krein theorem implies the interlacing property 
we want. □ 

Since TP matrices are dense in the class of TNN matrices, we obtain 

Corollary 4.2. (Generalized eigenvalues of TNN matrices:) Fix < k < n and let M G 

(^(n+k)x(n+k) ^ TA^A'^ matrix. Then the kth generalized eigenvalues of AI lie in [0, cxd) if k is 
even and lie in (— oo,0] if k is odd. Denoting the kth generalized eigenvalues of M by {yi)i=i.2,... 
and those of its principal leading submatrix by {xi)i=i^2,..., both of them ordered by increasing 
modulus and counting multiplicities, then we have the (weak) interlacing 

0< lyil < \xi\ < \y2\ < \X2\ < .... 

Note that the moduli can be removed if k is even and replaced by minus signs if k is odd. 
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Remark 4.3. In the process of approximating a TNN matrix by a sequence of TP matrices, some 
of the generahzed eigenvalues may escape to infinity. This wih always happen for the kind of 
banded matrices we are interested in. 



4.2 The approach of Eiermann-Varga revisited 



In the proofs of Theorems 12.71 and 12.121 we will use some ideas from Eiermann-Varga pj] , which 
we now review. 

Consider Qn{x) = (— l)"det(_ff„ — x/„) with _ff„ the n x n two-diagonal Hessenberg matrix 
in (|2.7p . Let P : [0 : n — 1] [0 : n — 1] be the permutation that sorts the indices according to 
their residue modulo p + 1, in the natural way, that is, 

(P(0),F(l),...,P(n-l)) = (0,p+l,2p + 2,...;l,p + 2,2p + 3,...;...;p,2p-H,3p + 2,...). 

Also denote with P the corresponding permutation matrix such that Pej = ep(j) for j € [0 : 
n—1]. Thus P has in its jth column the value 1 at position P(j) and zero at all other positions. 
We consider the permuted matrix P^^iJ„P — a;/„. It has a block bidiagonal structure: 



p-^HnP - Xin 



Xi Fi 



\ 



XpJ 



(4.10) 



where Xj 



-xIn with n," 



of the semi-infinite bidiagonal matrix 

/ 1 



V 



where Yj is the principal truncation of size rij x rij+i 



1 

O'P+j+2 1 

a2p+j+3 1 



(4.11) 



7 



for J £ [0 : p — 1] , and where Yp is the principal truncation of size Up x uq of the matrix 

fao 1 \ 
a2p+2 1 



Y — 



.12) 



Lemma 4.4. (a) Let A be a matrix of size n x n as in the right hand side of (j4.10|) . with 
diagonal blocks Xj — —xln^ ; J G [0 : p] . Then we have 



dot A = (-1) 



dct{YnYi ...Yp~ xP+^In 



(b) Under the same hypotheses, if we replace Xq by an arbitrary square matrix of size uq x uq, 
then we have 



detA = (-1) 



i-no n-{p+l)no 



det{YoYi...Yp+xPXo) 
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Proof. Use Gaussian elimination with the blocks Xi , . . . , Xp as pivots to eliminate the blocks 
above the main diagonal. After these operations, the block we obtain in the upper left corner is 
the matrix Xq + x^p YqYi . . .Yp. The exponent of x is easily determined. □ 

Note that the zeros of Qn are the points x where dct(P^^i/„P — xin) vanishes. Now we 
apply Lemma f4.4r a') to this determinant. Each of the matrices Yq,Yi, . . . ,Yp in (j4.11l) - (j4.12p 
is bidiagonal with positive entries and hence TNN. Thus also the matrix product YqYi . . .Yp is 
TNN (actually it is oscillatory [H]). This already shows that all the eigenvalues of YqYi ■ ■ - Yp 
are in [0,oo). Taking into account the factor x^'^^ in Lemma [4. 4f a), we then see that the zeros 
of Qn are all located on the star S+. 

Carrying on this approach a little further and using the Gantmacher-Krein theory, one obtains 
the (strict) interlacing relations for the zeros of the polynomials Qn and Qn+i, and for Qn and 
Qn+p+i- See Eiermann-Varga [,12^. Alternative proofs of the interlacing are in and '24' . 

4.3 Proofs of Theorems [2T] and [2A2] 

In this section we prove Theorems 12.71 and 12.121 To this end we will rely on Cor. 14.21 and the 
ideas in Section W?^ 

We always label rows and columns starting from 0. We will assume throughout the proof 
that n is a fixed multiple of p + 1 and we fix fc G [0 : p — 1]. The modifications if n is not a 
multiple of p + 1 are discussed at the end of this section. 

4.3.1 Proof of Theorem HHKa) {n a multiple of p + 1) 

Recall that Pk.n{x) is the determinant of the matrix obtained by skipping rows [0 : fc — 1] and 
columns [n — fc : n — 1] of Hn — xIn. Applying the permutation P above, this is equivalent to 
skipping certain rows and columns of the permuted matrix (j4.10l) . More precisely, Pk.n{x) is, up 
to its sign, equal to the determinant of the submatrix obtained by skipping the first row of each 
of the blocks ATg, Fg, Xi, Yi, . . . , Xk-i,Yk-i in (|4.10l) . and skipping the last column of each of the 
blocks Xp,Yp-i, Xp-i,Yp^2, ■ ■ ■ , -'^p-fc+i, ^-fc (here we are using the fact that n is a multiple 
oi p + 1). This can be seen as follows: if we write the submatrix of Hn — xIn as L{Hn — xIn)R, 
with L and R suitable submatrices of the identity matrix /„ (of size (n — k) x n and n x {n — k), 
respectively), and similarly the submatrix of P~^{Hn — xIn)P as LP~^{Hn — xIn)PR, then 
L = PiLP and R = P^^RP2, for some permutation matrices Pi and P2 of size n — k. 

Due to the above skipping of rows and columns, some of the diagonal blocks Xj in (j4.10l) will 
become rectangular instead of square. Thus we cannot apply Lemma |4.4I anvmore. Our goal is 
therefore to make all the diagonal blocks square again. More precisely, our goal is to get a matrix 
as in the right hand side of (j4.10p with diagonal blocks X'^ — —xl, for the identity matrix of 

/ -xl\ 

certain size, j £ [1 : p], and with Xq = ( g j ' write Xj, YJ to distinguish from the 

blocks Xj,Yj in (j4.10p .) We wiU then be able to apply Lemma Ol b). 

Recall that in the determinantal formula for Pk,n{x) we are skipping rows [0 : fc— 1] of H„—xIn. 
Then in the first k columns of this matrix there is only one non-zero entry left, being oq, . . . , Ok-i 
respectively. Expanding the determinant along the columns [1 : fc — 1] (we do not touch column 
0) we necessarily have to pick these entries. Then the determinant equals ±ai • • • a^-i times 
the determinant of the matrix obtained by skipping the rows and columns in which the entries 
oi, . . . , ttk-i are standing. These are columns [1 : fc — 1] and rows [p + 1 : p + k — 1]. 
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From the skipping of rows [p + 1 : p + fc — 1] , we see that in columns [p + 2 : p + k — I] there is 
only one non-zero entry left, being ap+2, . . . , ap+fe_i respectively. So again the determinant picks 
up a factor ±ap+2 . . . ap+fc_i, and we can proceed with the determinant of the matrix obtained 
by skipping the rows and columns in which the entries ■ ■ ■ , Op+fc-i are standing. These are 
columns [p + 2 : p + k ~ 1] and rows [2p + 2 : 2p + k — 1]. 

From the skipping of rows [2p + 2 : 2p + fc — 1], we now have only one non-zero entry left in 
each of the columns [2p + 3 : 2p + k — 1], being 02^+3, . . . , a2p+k-i respectively. We can then 
make a reduction as in the previous paragraphs. Carrying on this scheme a few more steps, we 
are left with the following submatrix of — .x/„ : It is obtained by skipping the rows 

[0:k-l]U[p+l:p + k-l]U[2p + 2:2p + k-l]U...Li{{k~l)p + k-l} (4.13) 

and the columns 



[1 : k - 1]U [p + 2 : p + k - 1]U [2p + 3 : 2p + k - 1]U . . .U {{k - 2)p + k - 1} 



(4.14) 



in the starting matrix _ff„ — xin ■ 

We can do similar operations with the last rows and columns of _ff„ — x/„. Indeed, recall that 
in the definition of Pk,n{x) we are skipping columns [n — k:n — \]oi iJ„ — a;/„. The determinant 
can then be further reduced to the one obtained by skipping the rows 

{n - (fc - l)p - fc} U . . . U [n - 2p - fc : n - 2p - 3] U [n - p - A; : n - p - 2] U [n - A; : n - 1] (4.15) 

and the columns 

{n - fcp - fc} U . . . U - 2p - fc : n - 2p - 2] U [n - p - : n - p - 1] U [n - fc : n - 1] (4.16) 

in the matrix — x/„ . 

Summarizing, we see that Pk,n{x) is, up to a constant, equal to the determinant of the 
submatrix of iJ„ — a;/„ obtained by skipping the rows (|4.13p and (|4.15l) and the columns (I4.14p 
and 

The skipping of the indicated rows and columns of iJ„ — x/„ is again equivalent (up to a sign) 
to removing certain rows and columns of the permuted matrix P^^HnP — xIn in (j4.10p . This 
leads to the formula 



Pk,n{x) = cdet 







\ p 



Y' 



Xi Y{ 



\ 



(4.17) 



c 7^ 0, where Xq is obtained by skipping the first k rows and last k columns of Xq; where 
X'j, J e [1 : p], is obtained by skipping the first max{fc — j, 0} rows and columns and the last 
max{j — p + fc, 0} rows and columns of Xj] where 1^', j G [0 : p — 1], is obtained by skipping the 
first max{fc — j, 0} rows and max{fc — j — 1, 0} columns and the last max{j' — p + fc, 0} rows and 
max{j — p + fc + 1,0} columns of Yj-; and finally Y^ is obtained by skipping the last fc rows and 
columns of y„. 



Note that each of the diagonal blocks Xj, j e [1 : p] in (|4.17p is of the form ~xl and moreover 

(4.18) 





Ofex/c 



-xl 
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with k zero columns added at the left and k zero rows at the bottom. Hence we are in a position 
to apply Lemma S^b): this yields 



c ^ 0. Note that each of the matrices Yq,Y(, . . . ,Yp in (|4.17p is bidiagonal with nonnegative 
entries and hence TNN. Thus also the matrix product Y^Y{ . . .Y^ is TNN. Cor. |4?2] and (09)) 
then imply that all the zeros of Pfc^„ lie on the star 5+ {S-) if k is even (odd). Finally, if we 
apply the Cauchy-Binet formula to det(y^'Y]' . . . Y^) then we see that this determinant is the sum 
of a finite number of nonnegative terms with at least one term strictly positive (for instance, 
the term obtained by multiplying the determinants of the principal leading submatrices of y/, 
i G [0 : p], is strictly positive). Noting that mk.n — k{p — fc) if n is a multiple of p + 1, we now 
obtain Theorem 12. Tf a). 

4.3.2 Proof of Theorem HHKb) (n a multiple of p + 1) 

Now we will prove the interlacing between the zeros of Pfe_„ and Pk,n+i in Theorem 12. yf b). still 
assuming that n is a multiple of p + 1 . 

Recall that in the determinantal formula for Pk^n+ii^) we are skipping the rows [0 : fc — 1] 
of Hn+i — xin+i- In exactly the same way as in Section |4. 3. 1[ this leads to an iterated skipping 
process, allowing us to skip the rows (I4.13P and the columns (I4.14p of Hn+i — xin+i- 

In the definition of Pk,n+i{x) we are skipping the columns [n — A: + 1 : n] of Hn+i — xl^+x- 
This leads again to an iterated skipping process, allowing us to skip the rows 

{n-(fc-2)p-A;+l}U. . .U[n-2p-fc+l : n-2p-3]U[n-p-fc+l : ri-p-2]U[n-fc+l : (4.20) 

and the columns 

{n-(fc-l)p-fc+l}U. . .U[n-2p-fc+l : n-2p-2]U[n-p-A:+l : n-p-l]U[n-A:+l : n] (4.21) 

of Hn+i — xin+i ■ Note that we are not skipping the rows n,n — p — l,n — 2p — 2, . . . and the 
columns n — p,n — 2p — l,n — 3p — 2, . . although we are allowed to do that. The reason for 
not skipping these rows and columns, is because that would complicate the comparison to the 
formulas ((iT^ - (|iTB for Pfc,„. 

In terms of the permuted matrix (|4.17p we obtain 




(4.19) 



(Xo Yp 
Xi 



\ 



Pk,n+l{x) 



cdet 



(4.22) 



Xp-i Yp^i 



\Yp Xp J 



c ^ 0, where the blocks Xj,Yj are obtained from the blocks Xj,Yj for Pk.n in (|4.17p by the 
formulas 





j <E[l:p-k], 



j E [p - k + 1 : p], 
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with e denoting the fcth last column of the identity matrix, and 

Yp_, = {y;_, e), Y, = (^^ je[p-k+l:pl 

with e denoting the last column of the identity matrix, and with the a* certain recurrence 
coefficients. Lemma l4^ b') yields 

Pk,n+i{x) = cx^'^-^^^P-''^ det (yoYi xP+i o)) ' (^-^^^ 

c ^ 0. But the cyclic product YqYi ... 1^ has YqY-[ . . .Y^ as its leading principal submatrix. 
Hence Cor. 14.21 yields the required interlacing relation in Theorem [5T7Jb) . It is also easy to see, 
as at the end of Section HXTl that det(loi^i ■■ - Yp) >Q. 

4.3.3 Proof of Theorem [2T7](c) (n a multiple of p + 1) 

Next we prove the interlacing between the zeros of Pk.n and Pi^^n+p+i in Theorem I2.7f c). still 
assuming that n is a multiple of p + 1. Observe that n + 1 is also a multiple of p+ 1. Applying 
exactly the same approach as in Section 14.3.11 we find that Pfc.„_|_p_|_i can be written as in the 
right hand side of (|4.22l) , where the blocks Xj , Yj are now obtained from the blocks X'^ , Y^ for 
Pk,n in (|4.17l) by the formulas 

with again e denoting the kth last column of the identity matrix, and 

je[0:p-k-l], 
j e[p-k 

with e denoting the last column of the identity matrix and with a* certain recurrence coefficients. 
We can again apply Lemma l4?4l b'). But the cyclic product YqYi ... 1^ has Y^Yl ... 1^' as its lead- 
ing principal submatrix. Cor. 14.21 then yields the required interlacing relation in Theorem 12. 7f c). 

4.3.4 Proof of Theorem 12.121 (n a multiple of p + 1) 

Next we prove the interlacing relations between the zeros of Pk,n and Pk.i,n in Theorem 12.121 
assuming that 1 < k < I < p and n is a multiple of p + 1. Recall that Pk,i,n is the determinant of 
the submatrix obtained by skipping the rows [0 : /c — 1] and the columns {n — ^}U[n — fc+1 : n — 1] 
of Hn — xin. This leads to an iterated skipping process, allowing us to skip the rows (|4.13p and 

{n-(fc-2)p-(fc-l)}U. . .U[n-2p-fc + l : n-2p-3] U [n-p-fc + 1 : n-p-2]U[n-fc + l : n-1], 

and the columns (|4.14p and 

{n-(fc-l)p-fc+l}U. . .U[n-2p-fc+l : n-2p-2]U[n-p-fc+l : n-p-lp{n-l]\j[n-k+l : n-l] 
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in the matrix Hn — xin- Then Pk,i,n can be written as in the right hand side of (j4.22l) . where 
the blocks Xj,Yj are now obtained from the blocks X'j,Y- for P/j_„ in (j4.17p by the formulas 



Xj - X', 







j G [1 i + 1, 





and 



Y — Y' 

- ' 



Y' 

^p—k 



Yp-i 
a 



e 



j e [p-fc + 1 



with the notations e, e, defined before. 

There is now a complication for the block Xp_;+i: this is a scalar multiple of the identity 
matrix but with the last column skipped. Moreover, Yp^i is a submatrix of Y^ ^ rather than the 
other way around. We will resolve both issues by appending an extra row and column at the 
end of some of the blocks in the matrix in the right hand side of (|4.22p . These extra rows and 
columns will have a triangular structure and therefore will not influence the determinant (except 
for a scalar factor), as we will see below. Here is the definition: we put 



Xn- 



l + l 



X„- 



p-l+1 



thereby making this block square again. We also put 



Xo 



Xo 




X, 



X, 
-a 



j e[l:p-l] 



with the zeros denoting a row or column vector, 

je[0:p-l-l] 



1 

for an arbitrary constant a ^ 0, and 



Yp^i := 



Yp-i 




^3 



ie[p-l + 2:pl 
3 ^[p-l + l:p\. 



As mentioned, the triangular structure of the added rows and columns implies that 



det 



(Xo % 

Xi fi 



Xp-^i Yp^i 



= ibadct 



fXo Yo 
Xi Yi 



Xp^i Yp^i 
Xp ) 



(4.24) 
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(To see this, expand the determinant on the left-hand side of (|4.24p along the last row of Xq 
and Yq. This row has only one nonzero entry. This allows to delete this row and also the last 
column of Yq and Xi . Next we expand the new deterrninant along the last row of Xi and Yi , 
and so on.) So we can work with Xj,Yj instead of Xj,Yj. 

Summarizing, Pk,i,n can be written as a constant times the left hand side of (j4.24l) . Combining 
the above descriptions, we see that the blocks Xj,Yj are obtained from the blocks Xj,Yj for 
Pk,n in (14.171) by the formulas 



and 



a 

Lemma |33fb) can be applied and yields 



Xj=X', J e[p-l + l:p-k], 



?.= (^' J), je[0:p-Z-l], 

Yp-i = ( 

Yj=Y;, j e[p-l + l:p-k-li 

Yp-k ~ {^p-k ^) ^ 

^j=(^ je[p-k + l:p]. 



Pk,i.n{^) = c:E'=(f-'=)+'=-' det (yoY, xP+' (^^^^^ J 



(4.25) 



c ^ 0. But the principal leading submatrix of YqYi . . .Yp is precisely the matrix YqY{ . . . Y^. 
Taking into account that mk^n = k(p — k) if n is a multiple of we then obtain Theorem l2.12l 



4.3.5 Modifications if n is not a multiple of p + 1 

If n is not a multiple of p+ 1, we can use the same ideas but with a few modifications. We focus 
on the construction for Pk^n in Section [4. 3. II We can again write Pk,n as in l|4.17p . But now the 
description of the blocks Xj,Yj depends on the residue g of n modulo p + 1, q £ [1 : p]. More 
precisely, the number of rows and columns to be skipped at the top and at the left of each block 
X'pYj, is exactly the same as in Section l4.3.1l But for the rows and columns at the bottom and 
at the right of each block, the description that was given for X'j , Yj in Section 14.3.11 should now 
be applied to Xj^^, Y-_^^ (where we view the subscripts modulo p+1). 

The above description implies in particular that X'q = (O — x/) , with k zero columns added 
f-xl\ 

at its left, and X'^ = ( ^ 1 , with k zero rows added at its bottom. All the other Xj are of the 

form —xl. Thus we are not able to apply Lemma 14.41 

To get around this issue, we append k extra rows and columns in the top and/or left part of 
some of the blocks. We set 

i-.^(lf), »), 



26 



where Ek is the submatrix formed by the first k rows of the identity matrix, and 

Y,=Y^, je[q:p]. 

Due to the triangular structure of the added rows and columns, they leave the determinant 
invariant up to its sign. So we can replace the X'^ , by the Xj , Yj . 

The blocks Xj are now all of the form ~xl, except for Xq which is of the form Xq — 
{ —xl\ 

„ _ . To bring the matrix to the form required by Lemma 14.41 it suffices to apply 

\Ufcxfc U J 

a cyclic block permutation. More precisely, we move each of the blocks Xj ,Yj, q positions to 
the top and to the left (in a cyclic way, thus reappearing at the bottom or right of the matrix 
when crossing the top or left matrix border respectively) . We relabel the blocks in the permuted 
matrix as Xj , Yj in the usual way. Thus Xj := Xj+q and Y- :— l^+g where we view the subscripts 
modulo p+1. 

Summarizing, we can write Pk,n as in (j4.17p . where the blocks Xj, Yj have the form described 
in Lemma 14.41 The blocks X'j , Yj will play exactly the same role as in Sections I4.3.11 - I4701 

The above construction for Pk,m can also be used for the matrices associated to Pk,n+ii 
Pk,n+p+i and Pk,i,n- The blocks in these matrices differ from those for Pk^n only in their bottom 
right matrix corner. So the above modifications, which only affect a fixed number of top and 
left rows and columns in each block, are exactly the same for each of these matrices. Since 
the interlacing relations are obtained by comparing the bottom and right rows and columns, the 
proofs in Sections 14.3. 2fH75^ then carry on in exactly the same way as before. 

The only effect of adding rows and columns at the top or at the left, is that it changes the sizes 
of some of the blocks Xj,Yj . The sizes depend explicitly on the residue g of n modulo p+ 1. The 
same then holds for the exponents of x yielded by Lemma 14.41 The details are straightforward. 

Remark 4.5. To obtain the values for mk^n in (j2.16p and the fact that Pfc,„(0) 7^ in Theorem l2.7l 
with the above approach, one has to do a careful bookkeeping. Another approach for checking 
these statements is to use (15. 6p below. It suffices there to find the patterns s that yield the lowest 
exponent of x in (|5.6p , which is a combinatorial exercise. 

4.4 Interlacing for arbitrary Riemann-Hilbert minors 

The techniques in Sections 14.3.41 and 14.3.51 can be used to prove the following result for arbitrary 
Riemann-Hilbert minors. It generalizes Theorem 12. 121 

Theorem 4.6. Consider the two-diagonal Hessenberg matrix Hn in (12. 7p . where n is sufficiently 
large. Let fc G [0 : p — 1] and k G [0 : k — 1] and consider the polynomials P"^(a:) and P"^(x) (c/. 
([33)) ). with 

Hi — (uq, . . . , n^, n — fc + K + 1, . . . , n — 1, n), (4.26) 
n2 = ("0, • ■ • , "k-i, - fc + K, . . . , n - 1, n), 

where 

n— p<n()<ni<---<ni^<n — k + K, (4.27) 
and the last fc — k (fc — k + 1) components of ni (n2) are taken consecutively. 
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(a) We have 

/or some explicit m depending only on the residues of the indices hq, . . . ,ni^,n modulo p+l. 
The zeros of the above polynomials P lie in (^-) if k is even (odd). 

(h) Denote by {yi)i=i^2,... o-nd {xi)i^i^2,... the roots of P^^{x) and P'^^{x) respectively, counting 
multiplicities and ordered by increasing modulus. We have the weak interlacing relation 

< < |a;i| < \y2\ < |a;2| < — 
5 Normal family estimates 

The goal of this section is to prove the foUowing result. 

Lemma 5.1. (Normal family:) Let k E [0 : p] be fixed, and assume there exists an absolute 
constant R > so that 

R-^ <an < R, n> 0. (5.1) 

Then for any compact set /C C C \ 5*+ (if k is even) or IC C C\S- (if k is odd) and for any fixed 
set of indices ij G Z, j € [0 : k], with 

ia <ii < ... <ik <'io+P, (5.2) 
there exists a constant M > so that for all x E IC and for all n we have 



p(n+»o,"+n,...,«+»0(2;)/Pj^„(a;) <M. (5.3) 



Lemma 15.11 is proved in Section 15.21 In the proof we will need a combinatorial expansion of 
the generalized eigenvalue determinant p("o,".i,---,".fe)^ which we turn now. 

5.1 Combinatorial expansion of generalized eigenvalue determinants 

We start with a definition. 

Definition 5.2. Let p G N, fc G [0 : p] and n ~ p < uq < ni < . . . < Uk = n he fixed numbers. 
A pattern is a sequence s — {sj)"^Q such that sj G {0, 1} for all j, with boundary conditions 

So . . . Sfe_i = 1, (5.4) 

g.^fl, J = 7io,ni, . . . ,^ 
^ \ 0, j e[n-p:n-l]\{no,ni,...,nk-i}, 

and such that the following rule holds: 

Pattern rule: For each j G [0 : n — p — 1] with Sj = 1, exactly k out of the p numbers 
Sj+i, . . . , Sj+p are equal to 1. 

We denote with S the set of all such patterns s. 

For example, li p — A, k — 2 and (no,fti,ft2 — n) — (14, 15, 16) then the following sequence 
is a pattern: (sj)jlo ~ 1' 0, 1, 0, 1, 1, 0, 0, 1, 1, 1, 0, 0, 1, 1). For instance, note that S3 = 1 and 
exactly 2 out of the 4 numbers {34,55,56,37} are equal to 1, namely the numbers S5 and sg. 

For a pattern s G S, write |s| = X]J=o ^^ '^i' Thus |s| is the number of indices j G [0 : n—p — l\ 
for which Sj 1. In the example above we have |s| = 8. 
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Remark 5.3. Let s be a pattern and consider a group of p consecutive numbers (sj)^„j_p, 
p < m < n. Def. 15.21 easily implies that #{j e [m — p : m — 1] \ Sj — 1} e {k, k + 1}. 

Remark 5.4. In the case fc = 0, we understand that there is no initial condition (15. 4L and (15. 5p 
reduces to ask sj = for all j G [n — p : n — 1]. 

Proposition 5.5. T/ie generalized eigenvalue determinant p("o,ni, •■■,"&) ^htt, 6e written as a sum 
over patterns: 

(n-p-l \ 
Y[ af (_a;)(fe+i)(«-fe)-(p+i)NI-/, (5.6) 
j=o J 

where q :— X]^=o + j ~ k — nj) > 0. 

Proof. In the proof we assume that fc > 1. Simpler arguments can be applied to prove (15. 6p 
in the case k = 0. By definition, p("o,«i,...,nA,)(a;) is 

the determinant of the matrix obtained by 
skipping rows 0, . . . , fc — 1 and columns no, . . . , rik-i of the matrix iJ„ — xl, with n — n^. We 
write this determinant as a signed sum over all permutations a of length n — k: 

p(«o,n„...,n.)(^) ^ E (-l)^'^"(^Mn(if„-a;/).,.wJ (5.7) 

where (-ff„ — xl)i,j denotes the (i, j) entry of Hn — xl and we view cr as a map a : [fc : n — 1] — > 
[0 : n — 1] \ {no, ni, . . . , Uk-i}, in the natural way. We will often find it convenient to use the 
inverse map a~^. 

Since iJ„ — xl has only three nonvanishing diagonals, most of the terms in the sum (|5.7|) will 
be zero. To have a nonzero term we must have a~^{i) G {i ~ l,i,i + p} for all i. For such a 
a, we define a sequence {sjYj~Q~^ by sj = 1 if a~^{j) = j + p (meaning that the permutation 
a selects the entry (i?„ — xl)j+pj = aj) and Sj = otherwise. We define the boundary values 
(sj)"r^_p as in (|5.5p . We claim that this sets up a bijection between the permutations a leading 
to a nonzero term in (|5.7p . and the patterns s G 5. 

To prove this assertion, consider the matrix obtained by skipping rows 0, . . . , fc — 1 of Hn — xl. 
Its leading principal submatrix of size 2p — fc + lbyp+1 can be partitioned in blocks as follows: 



p — k 
fc 

-fc + 1 




(5.8) 



where A — diag(ao, . . . , ak-i), B = diag(afc, . . . , ap), X = \ • . . ■ . | , and Y has its 

—X 1 y 

top right entry equal to —a; and all its other entries equal to zero. 

Observe that in each of the first fc columns of (|5.8I) there is only one nonzero entry, being of 
the form aj, j € [0 : fc — 1] in the block A. The permutation a has to pick these entries. Hence 
So = . • ■ = Sk-i = 1, consistent with (j5.4D . In particular, since we have to pick ao, we are not 
allowed to choose the entry —x in the top right corner of the block Y. 

Now in each of the first p — k rows of (jS.Sp . a has to pick either the entry —x or the entry 1 
from the corresponding row of the block X . Since X is rectangular with one more column than 
row, there will be one of the chosen entries in each of the columns of X except one. This means 
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in turn that o has to pick exactly one of the entries a^, . . . , of the block B in (j5.8p . So exactly 
one of the numbers Sk, ■ ■ ■ , Sp equals 1 and the others equal zero. 

Now let < j < i < n — p he two integers with Sj = Si = 1 and Sj+i = . . . = s.i_i = 0. 
Assume (by induction) that exactly k out of the p numbers Sj+i, . . . , Sj+p equal 1. By the above 
paragraphs, this holds if j = 0. We will prove that exactly k out of the p numbers s^+i, . . . , Si+p 
equal 1. Applying this argument iteratively, we will then obtain that {sj)"^Q satisfies the pattern 
rule (Def.EIll). 

By assumption we have that exactly k of the numbers Sj+i, . . . , Sj+p equal 1. By the definition 
of i, this implies that exactly fc — 1 of the numbers s^+i, . . . , Sj+p equal 1. So it will be enough 
to show that exactly one of the numbers s^+p+i, . . . , s^+p equals 1. 

Consider the submatrix of H„ — xl obtained by extracting rows j + p, . . . ,i + p: 



( aj 



V" 







-X 1 










-X 1 



(5.9) 



a* 



1 / 



Note that the entry —x in the topmost row lies either in the same column or in a column to the 
right of fli. This follows from our assumptions that exactly A: > 1 of the numbers Sj+i, . . . , Sj+p 
equal 1, and Sj+i = • • • = Si^\ = 0. Now since a picks the entries and Ci, the entries —x and 
1 in the first and last row of (j5.9D cannot be chosen. On the other hand, a has to choose one 
of the entries —x or 1 from each of the rows containing a^+i, . . . ,ai„i in (j5.9l) . Since the block 
formed by the entries —x and 1 lying between the two horizontal lines in (j5.9p is rectangular 
with one more column than row, there will be one of the chosen entries in each of its columns 
(i.e., the columns [j + p + 1 : i + p]), except one. This implies in turn that u has to pick exactly 
one of the entries Oj+p+i, . . . , a^+p. Thus exactly one of the numbers Sj+p+i, . . . , s^+p equals 1, 
proving the claim of the above paragraph. 

In the above argument we were tacitly assuming that [j + p+ 1 : i +p] is disjoint from the set 
of skipped columns {no, ni, . . . , nfc_i} in the definition of p("o,ni, jf ^jjjg disjointness fails, 
then similar arguments as above show that [j + p + 1 : i + p] must contain exactly one of the 
indices no, ni, . . . , nfc_i, and again, exactly one of the numbers Sj+p+i, . . . , s^+p equals 1 (recall 

my 

Summarizing, we have proved that each permutation a leading to a nonzero term in (|57 
defines a pattern s ^ S with 



Sj = 1 if and only if it ""^(i) = J + p, j G [0 ; n — p — 1]. 



(5.10) 



Conversely, we claim that each pattern s £ S leads to a unique permutation a satisfying (|5.10p 



and associated to a nonzero term in (|5.7p . We call a the permutation induced by s £ S. To prove 
its existence and uniqueness, let again j < i he two numbers with Sj = Si = 1, Sj+i = . . . = 
Si-i = 0. As observed before, exactly one of the numbers s^+p+i, . . . , Sj+p equals 1; denote this 
number by s;+p, for suitable I. Skipping the corresponding column in (I5.9|) . the block formed 
by the entries ~x and 1 lying between the two horizontal lines in (|5.9p then takes the form 
diag(C, D) with 



/I 



C = 



D = 



V 



(i-/)x(i-/) 
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Note that both matrices C and D are square and triangular with nonzero diagonal entries. Hence 
if CT is a permutation induced by s, then we should have a~^(ra) = ra, for m £ : l+p— 1] 

(so that a picks the diagonal entries of C), and a~^{m) = m — 1, for m G [/ + p + 1 : i + p] (so 
that (7 picks the diagonal entries of D). If we follow this rule consequently for all j < i with 
Sj = Si ^ 1 and Sj+i — . . . — Si-i — 0, and use a similar reasoning near the top left matrix 
corner (j5.8|) . and near the bottom right matrix corner, then we will end up with the unique 
permutation a induced hy s € S. This proves the existence and uniqueness of a. 

Now let s 6 iS be a pattern with induced permutation a. We claim that sign((T) = (— . 
To see this, recall that sign((T) = (—1)^^ where K is the number of pairs of column indices (j, i) in 
[0 : n — 1] \ {no, . . . , nk-i} with j < i and cr^^(j) > a~^(i). Since cr^^(i) G {« — 1, i,i+p} for all i, 
in our case K is the number of pairs of column indices (j, i) with j G [0 : n — p — 1] , i G [j '■ j + p\, 
cr^^ij) = j + P (i.e., Sj = 1) and cr^^{i) £ {* — 1,*} (i-e., Si = 0). But if j G [0 : n — p — 1] 
is such that Sj = 1 then exactly p — fc of the numbers Sj^i, . . . , Sj^p are 0, by Def. 15.21 Thus 
K = {p — k)\s\ and sign(cr) = (— proving our claim. 

Let again s G 5 be a pattern with induced permutation a. Let a, h, c be the number of indices 

i G [k : n — 1] with a{i) = i — p, (T{i) ~ i and a{i) = i + 1, respectively. Thus a, &, c denote the 
number of entries of iJ„ ~ xl of the form aj, —x and 1, respectively, that are picked by a. We 
have the two relations 

fc-i 

a + b + c = n — k, pa — c + ^^(i — rii) = 0. (5.11) 

4=0 

The first relation is obvious. The second one follows from X)"=fe (* ~ '''(*)) + 2i=o^(* ~ ~ 
0, due to the facts that ct is a permutation and we are skipping the rows 0, 1, . . . , fc — 1 and 
columns ng, ni, . . . , nfc_i of i7„ — xl. Now by adding the two relations in (jS.llI) . we obtain 
b — (k + l){n — k) — (p+l)a — g with q as in the statement of the proposition. This yields the 
exponent of —x in (|5.6p . Putting together all the above observations, we obtain (j5.6p . 

□ 

Next we state a technical lemma on the existence of patterns with prescribed initial part. 

Lemma 5.6. Letp,k,n and K > {p + l){k + 1) + pk be positive integers and let {sj)^Z^ satisfy 
(|5.4p . with Sj G {0, 1} for all j, and such that the pattern rule holds for all j G [0 : n — K — p]. 
Then for any indices (nj)^^Q with n — p < uq < ni < . . . < Uk = n one can assign the numbers 
i^j)^=n-K+i such that (sj)"^^ is a pattern with respect to these indices (Def. \5.'^) . 

Proof. We will assume that K = K := (p+ l)(fc + 1) + pk; the case where K > K is discussed 
at the end of the proof. 

Consider the group of p consecutive numbers (sj)™_p+i with m — n — K. Remark 15.31 
implies that it has exactly fc or fc + 1 entries equal to 1. Assume these entries are at the positions 
m — p + ij, j € [I : k], with I G {0, 1} and 1 < i; < . . . < u- < p. We define the next group of 
p consecutive numbers (sj)™^f such that it has precisely k entries equal to 1, standing at the 
positions m + ij, j G [1 : k]. This definition is valid since it satisfies the pattern rule. 

Next, we define {sj)^iXp+i ^^'^^ ^'^ precisely at the positions m + p + ij with 

ii = 1 and ij ~ ij for j G [2 : fc]. In the next group (sj)™+2p+i P'^t 1'^ '^'^ indices 
TO + 2p + ij with ii = 1, 12 = 2 and ij — ij., j G [3 : fc]. We repeat this procedure until we arrive 

(*i)m+ip+V^ '^it'^ I's its first fc positions and zeros elsewhere. We also define each of the 
numbers (sj)™^|^[|]i[N'']j[J as 1. These definitions are compatible with the pattern rule. 
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Next, we use a similar strategy to arrive at the prescribed boundary conditions (jS.Sp . Setting 
(k + l){p + 1), we know from the last paragraph that the group has I's 



m 



at its last k positions and zeros elsewhere. Then we define (sj)^'^^ ^ with I's at the position 
~ '-p + riQ — n and at its last k — 1 positions. Next, we define (sj)^^^^^^ with I's at the positions 



m 
m 



2p + no — n, m + 2p + ni 



end up with {sj)^'^^j^_^s^p having I's at the positions m 



n and at its last fc — 2 positions. Repeating this process, we 
kp + rij — n, J G [0 : fc — 1], and zeros 



elsewhere. These definitions are compatible with the pattern rule. Moreover, one checks that 



m + kp ' 



Hi ^ n = n 



3 ' 



kp — 1 = n — 1. 



So we obtain the desired boundary condition (j5.5p . 

Finally, it K > K := {p + l){k + 1) +pk then we arbitrarily assign the numbers (sj) 

so that the pattern rule is satisfied. We then use the extended sequence {sj)"^^^ and proceed in 
exactly the same way as before. □ 



-K 
j=n-K+l 



5.2 Proof of Lemma 15.11 

We write (|5.6p in the form 

p(Tio,ni,...,nfc) j-^-j _ ^_^-j(fc+l)(n-fe)- 



\ik+l)\s\ 




(5.12) 



with y :— x^^^. Suppose that fc is odd and y = x^^^ G M_|_. Then in the above sum, each term 
is real and positive and hence no cancelation can occur. The same happens if fc is even and 
y = xP+i e R_. 

Consider the ratio of polynomials in (15. 3p . Both the numerator and denominator can be 
written as in (j5.12l) . Let s = (sj)"^o''~^ be a pattern corresponding to the indices n+io, ■ ■ ■ , n+ik- 
Lemma |5 . 61 implies that there exists a pattern i" = {sj)"ZQ corresponding to the indices [n — fc + 1 : 
n] such that Jj = Sj for all j ^ [0 : n ~ K], with K — max{(fc + l){p + 1) + kp, —ik + 1}. Clearly 
there are only finitely many such patterns s (or s) with prescribed initial part {sj)'^Z^ (or 
(sj)"'!^). Now for each fixed y G C \ {0} there exists a constant M > so that 



n—p—1 



n / y-^'^ n 



3=0 



< M, 



(5.13) 



uniformly in n. This is because the products in the numerator and denominator are equal except 
for at most a finite number (independent of n) of factors aj and y, and in view of (j5.ip . We 
conclude that for each fixed x G 5+ \ {0} (if fc is odd) or a; G S*- \ {0} (if fc is even) there is a 
(new) constant M > so that 



(5.14) 



uniformly in n. This is due to the termwise estimate (|5.13p and our earlier observation that the 
terms in (j5.12p are all real with fixed sign. This already gives us a normal family estimate on 
compact sets of 5*+ \ {0} (if k is odd) or S- \ {0} (if fc is even). 

To obtain the full statement of Lemma lSTTl we recall the interlacing relation for the generalized 
eigenvalues in Theorem l4.6l With the notations rii , n2 as in (|4.26l) , Theorem l4.6l vields the partial 
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fraction decomposition 



P"^(x)/P"i(x) =ao+ c^^/i^-y^), (5.15) 

1=1,2,3,... 

where the numbers ai, a2, • • ■ aU have the same sign, which is also the sign of ao if k is odd, or 
minus the sign of ao if k is even. For convenience we will assume that k is odd. In view of (|5.14p 
we already know that the left hand side of (jS.lSp is uniformly bounded in n for each fixed point 
X G IR+ \ {0}. Fix such an x. In view of the above observations we have 

|ao|<M, J2 \ar\/distix,yi) < M, 

1=1,2,3,... 

uniformly in n, where dist is the Euclidean distance and we used that x > 0, yi < and all terms 
in (|5.15p have positive sign. But now for any compact set /C' C C \ R_ there exists i? > so that 

R^^ < \dist{x,yi)/dist{t,yi)\ < R, for aU t e K.' and yi G M_. 

This now easily implies that 



< M, 



for a new Af > and for all t ^ K,' , uniformly in n. This already shows that the family of ratios 
(|5.15p is normal on C \K_. Applying (|5.14p two times for appropriate indices, we know that for 
each i > there exists a constant M' > such that 



> M' 



for all n. This observation and Hurwitz' theorem imply that for any compact set /C' C C \ ]R_, 
the functions (|5.15p are also uniformly bounded from below on K,' by a positive constant. This 
proves (j5.3p for the ratios P"^ (<) /P"i {t) . Similarly, using Theorem I2.7r b) we obtain 

< |Pfc,„(t)/Pfe,„+i(t)| < M, (5.16) 



for all t in a compact /C C C \ S*-, uniformly in n. But now the ratio of polynomials in ([57 
can be written as a product of finitely many ratios of the form (|5.16p or P"^(t)/P"i(i), or their 
inverses, recall (j4.26p . This yields Lemma ISTTl □ 

Remark 5.7. The proof of Lemma lSTTl simDlifies considerably when fc = or = p. This is because 
in the former case we deal with the polynomials Qn{x), whose zeros are uniformly bounded on 
5+, while in the latter case the numerator and denominator in (j5.3p are simply constants. 



6 Proof of the Widom-type formula 



In this section we prove Theorem 12. 141 For ease of exposition let us assume for the moment that 
the period r is sufficiently large: r > p. The condition (12.231) implies that H is a tridiagonal 
block Toeplitz operator 

/So B-i \ 

Bi Bq P-1 



H 



B, 



Bn 



.1) 
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where the blocks Bk are of size r x r and given by 

\ 



fC 1 



Bn = 



V 



r—p— 1 



/o 



Bi = 



B-i 



Vo 



/ 



(6.2) 





1 



(6.3) 



where denotes either a row or a column vector and the in the top right corner is a square 
matrix of size r — 1. The symbol F(z, x) of the block Toeplitz matrix (j6.ip is defined as j6i |30] 

F{z, x) = B^iZ^^ + Bq + BiZ - Xir, 



where is the identity matrix of size r. One checks that this definition coincides with (j2.24p . 
In fact, a similar reasoning can be used also if r < p [3 Sec. 4]. 

The determinant of a banded block Toeplitz matrix is given by the next result. 



Lemma 6.1. (Widom's determinant identity:) Under the assumptions of Theorem \2.14\ 
have for all n sufficiently large that 



Qrnix) := det{xlrn - Hm) = ^ Cfe (x) (zfe (x)) " \ 



fe=0 



with 



Cu{x)^det (^l-jj{z,x)-^^ 



(6.4) 



(6.5) 



where F{z, x) is the symbol (I2.24p and <j is an arbitrary, clockwise oriented, closed Jordan curve 
enclosing z — Q and the point Zk{x), but none of the other points Zj{x), j G [0 : p], j ^ k. 

Lemma. 16.11 follows by specializing Widom's result [30] Theorem 6.2] to the present setting. 
We now find a more explicit form for the coefficients Ck{x). 

Lemma 6.2. Under the assumptions of Lemma. 16. Jl we have 

{-ly dctF'-^'°{zk{x),x) 



Ck{x) 



k e [0:p]. 



fp Uj^ki^kix) - Zj{x))' 
Proof. We start from formula (j6.5p . Note that this formula involves the matrix 

F{z,x) := F{z,x)~^, 
which can be written in entrywise form as F{z, x) = {Fij{z, x))^^}^q with 

,.det F^''{z,x) 



(6.6) 



F,,,(z,x) = (-1)^+^-- 



i,j e [0 : r - 1], 



detF(z,a;) ' 

thanks to the well-known cofactor formula for the inverse of a matrix. 



(6.7) 
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Now we consider in more detail the numerator and denominator of (16. 7p . For the denominator 
we have 

detF(z,a;) = f{z,x) = {-ly-'^ z''^ + 0(1), z ^ 0, 
by virtue of p.lip - (|1.13p and (|2.24p . For the numerator we have 

(detF^^^(z,x))[jio = ^(^J o)+0(l), z^O, 

where each is a row or column vector and where R is an upper triangular matrix with I's on 
the diagonal. Indeed, this follows due to the particular form of (j2.24p . (jl.l2p . Observe that in 
the matrix F{z, x), the entries with index with j > i + 2 are of order 0{z) as z ^ 0. This 
explains the upper triangularity of R. Secondly, the presence of I's in the first super-diagonal 
of F{z,x) and of 1/z in the bottom left corner of the same matrix implies that for j = i + 1, 
detF^'^{z,x) = (-l)7z + 0(l) as z -> 0. 

Inserting the above expressions in (j6.7p . we obtain 

F{z,x)=(^^ o) ^^-^^ 

for a new upper triangular matrix R with I's on the diagonal, where ^ denotes the transpose. 
We also need the behavior of F{z,x) for z Zk{x). Note that 



fiz,x) = ^-ff[iz~zt{x)), 



see ([ri3)) - ([ri4)) . Hence from ((6J)) we have 



for i,j e [0 : r — 1]. The factor z — Zk{x) in the denominator of (|6.9p shows that Fij{z,x) can 
have a simple pole at z = Zk{x). Widom [30, Sec. 6] observed that the matrix with the residues, 

(Res3^^,(^) F^^j{z,x)] , (6.10) 

V / i.j— 

is a rank-one matrix. 

Now we can finish the proof of the lemma. With the contour a as in the statement of 
Lemma [6.11 we find from (|6.8p and the residue theorem that 

^ [ F{z,x)— = - ^) ^ (Res^^^^f^^) Fij{z,x)) 

Since (j6.10p is a rank-one matrix, simple linear algebra then shows that 

det ( -^-7 [ F{z,x)—] = ]—Res^=^^(^^) Fo^r-i{z,x). 

Using (|6.9I) . we conclude that 

1 f .dz\ _{-lY dctF^-^'^{zkix),x) 



I\j^k(Mx) - Zj{x))' 

Comparing this with (j6.5p . we obtain the desired formula (|6.6p . □ 
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Proof of Theorem \2.14\ For ease of reference in the next section, we will give the proof for the 
case of a two-diagonal Hessenberg matrix (|2.6p . It will be clear that the same proof also works 
for a general Hessenberg matrix (j2.12p . From (j2.8p we have 



/ 



V 



Qji^ji — i^p 







O'rn—l 



(Xrn-\'r — 2—p 



Qrn — 1 (^) 
-X I J \ Qrn+r-lix) J 



= 0, 



.11) 



where the matrix multiplying the column vector, which we call M{x), is of size r x 2r. Let us 
denote by Bn{x) and C„(a;) the matrices formed by the first r columns and last r columns of 
M(x), respectively, i.e. 



/ 1 





/ 




^rn—p—1 


Bn{x) = 















^rn — 1 




\ 









Cn{x) 



\ 



V 



^r7i-\-r—'p—2 



-X 1 J 



(6.12) 

where denotes zero blocks of appropriate sizes, such that the last r — p — 1 rows and the first 
r — p ^ I columns of Bn{x) are zero. Here we are assuming that r > p + 1] the case r < p will 
be discussed in Remark 16.41 Using the vectorial notation 



we then write the recurrence (j6.1ip as 

Q„(a;) = A„(a;)Q„_i(a;), with An{x) := -C~'^{x)Bn{x), 



(6.13) 
(6.14) 



for n > I. Now the periodicity assumption Om+j — bj implies that Bn{x) —: B{x), C„(x) —: 
C(x) and An{x) —: A{x) are all independent of n. By repeatedly using (j6.14L this yields 

Q„(a;) = A(x)"Qo(x). (6.15) 

Assume that A is a non-zero eigenvalue of A{x). Then det(i?(a;) + XC{x)) = 0. But now 



'Xx 



B + \C 



^r—p—1 



Xbn 



\ 



Xbr-p-2 



-Xx 



-x\ 

br-1 

A J 



If we perform the following operations to B(x) + XC{x): divide rows 2 to r by A, move row 
1 to the bottom and move rows 2 to r one level up, the resulting matrix is exactly _F(1/A,x). 
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Therefore detF(l/A,x) = and A = l/zk{x) for some fc G [0 : p]. In conclusion, the non-zero 
eigenvalues of A{x) are given by 1/2:^(0;), fee [0 : p]. Since the first r — p — 1 columns of A{x) 
are zero, is also an eigenvalue of A{x), with multiplicity r — p — 1. 

The eigenspace of A{x) associated with the eigenvalue l/zk{x) is one-dimensional and coin- 
cides with the nuUspace of F{zk{x),x). By Cramer's rule it is easy to see that this subspace is 
spanned by the vector 

Vfc(a;) = (deti^'-i^O(z,(a;),x), -deti^'-i^i(0fe(a;),x), . . . , (-l)'^-MetF'-i^'--i(0fe(a;),x))^ , 

(6.16) 

for any A: G [0 : p], whenever the vector (|6.16l) is nonzero. 

Let us show that the first component of Vfc(j:) is zero for only finitely many x. Let TZ be 
the compact Riemann surface associated to the algebraic equation f{z,x) — whose roots are 
the functions Zk{x). The collection of functions det F^~^'° {zk{x) , x) , fc e [0 : p], can be seen as 
a single meromorphic function defined on TZ. (It has poles at infinity, see also [H]). Now [3 
Lemma 5.5] (see also [7J Lemma 5.6]) shows that TZ is connected. Hence the above meromorphic 
function cannot be identically zero since this would imply by (j6.4D and (|6.6p that Q™ = 0, clearly 
contradictory. Hence, each function det F'^~^'^{zk{x),x) has only finitely many zeros in C. 

Now define the matrices 

D{x) :=diag(zo(a;)"\ zi(a;)~\ . . . , Zp(x)~\ 0, . . . , 0)rxr, 
V(x) {vq{x),vi{x), Vp(x), ei, . . . , e,._p_i)^^,, , 

where e.^ denotes the standard column unit vector of index i. Then A{x) — V{x)D{x)V~^{x), 
and so (|6.15l) gives 

Qnix) = Vix)D{xy'V-\x)Qo{x). (6.17) 

We already know the expression of Qm, see (|6.4p and (|6.6I) . This allows us to find that the 
first p 4- 1 components of the vector V^^{x)Clo{x) are 

(-!)'• 1 (-!)'• 1 ^ (^^-1 

fp - Z^{x)) ° fp Ui^piZpix) - Z^{x)) ^ 

From this observation and (j6.17p . the desired formula (j2.25p follows immediately. 

We have actually shown that (12.25^ is valid for all points x e C satisfying two conditions, 
namely that the roots 2:^(2;), fc 6 [0 : p] are pairwise distinct, and the vectors Vkix), k G [0 : p], 
are all nonzero. The collection of points in C for which the first condition holds but the second 
fails is finite, as we have already seen. By continuity it is clear that formula (|2.25p is also valid 
for the exceptional points in this finite set. 

With (|2.25p at our disposal, we can prove as before that the functions det F^~^'^ {zk{x), x) 
are zero for only a finite set of a; e C. Finally, to sec that the same holds for each function 
det F*'^ (zfe(a;), x), apply formula (I2.25P for the monic polynomials associated to the cyclically 
permuted symbol Z~'~^F(z, a::)Z*+^. □ 

Remark 6.3. Let a; G C be such that the values Zk{x), fc G [0 : p], are pairwise distinct. We 
already observed that there are at most finitely many such x with the property that the vector 
(|6.16p is zero. For such x, Vk{x) will always denote in the next section an eigenvector of A{x) 
associated with the eigenvalue l/zk{x). 

Remark 6.4. To obtain (I6.14p we assumed that r > p + 1. If r < p we proceed as follows. Let 
m G N be large enough so that f := mr > p+l. The matrix H, which is periodic of period r, can 
also be viewed as a periodic matrix of period r. Let F{z,x) be the associated symbol. Linear 
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algebra shows that the roots Zk{x) of detF{z,x) = are given by Zk{x) := Zk{x)"^, k G [0 : p]. 
Moreover, the null space vector Vk{x) such that F{zk{x), x)vk{x) — can be constructed as 
follows. With Vfe denoting the vector of length r in (|6.16p . we define the vector of length f by 

Vfc(x) = {wk{xf,zk{xr\kixf, Zk{x)-"'+\k{xff . (6.18) 

With this vector (|6.18p playing the role that was played before by Vfc(a;), the above proof goes 
through in exactly the same way as before. This leads again to the same formula (j2.25p . 

7 Ratio and weak asymptotics of Riemann-Hilbert minors 

7.1 Generalized Poincare theorem 

The following result is contained in [31] , see also [17] . It is closely related to the theory of Krylov 
subspaces and subspace iteration in numerical linear algebra. 

Lemma 7.1. ( Generalized Poincare theorem:) Assume that (A„)^]^, A are nonsingular matrices 
of size m X m, m S N, and A = lim„_i.oo An- Suppose that A is diagonalizahle with eigenvalues 
satisfying 

|Ai| > IA2I > •■• > |A,„| > 0. 

Let vi, . . . , Vm he eigenvectors associated to the eigenvalues Ai, . . . , Am, respectively. Let (u„)^q 
he a sequence of column vectors with Uq 7^ 0, generated by the recurrence 

u„ = A„u„_i, n > 1. 

Then there exists a sequence of complex numhers (c„)„ such that c„u„ — Vj , for some j £ [1 : m] . 

We need a multi-column version of Lemma 17.11 

Lemma 7.2. Under the same assumptions of Lemma \7. 1\ let {Un)'^^Q be a sequence of matrices 
of size m X /, / G [1 : m], with Uq having linearly independent columns, such that 

Un = AnUn-1, n > I. 

Then there exists a sequence (C„)^q of invertihle, upper triangular matrices of size I x I such 
that 

hm UnCn = {-Vj, , , . . . , Vj J , 

the matrix with columns v^j , . . . , Vj, , where ji, . . . , ji are I distinct indices in [1 : m] . Here the 
limit is defined entrywise. 

Proof. We prove this lemma by induction on I. For I — 1 it reduces to Lemma l7.1l Let us assume 
as induction hypothesis that the result holds for the index I — 1. Thus there exists a sequence of 
upper triangular, invertible matrices C„ of size / — 1 such that, if we write 

M„:=(uW,...,ui'-i))C„, (7.1) 

with u^*^ denoting the ith column of Un, then 

lim M„ = (vji , Vj, , . . . , Vj,_ J, (7.2) 

n— >oo 

where ji, . . . ,ji-i are distinct indices in [1 : to]. 
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For n large enough, there exists a unique column vector d„ such that the vector 

w„ := u« + M„dn e C" (7.3) 

does not have a contribution from the vectors Vj^ , v^^ , . . . , Vjj_j , i.e., if we write w„ in terms of 
the basis {vi}™;^ of C™, then the coefhcients multiplying Vj^, . . . , Vj,_j are zero. To see this, 
observe that finding the coefficients of d„ amounts to solve a non-homogeneous linear system 
whose coefficient matrix tends to the identity matrix, thanks to (17.21) . Observe that w„ ^ 
for all n, because otherwise we would have a linear dependency between the columns of C/„ and 
therefore (by the recursion [/„ = AnUn-i with An nonsingular) between the columns of Uq, 
contrary to the assumptions of the lemma. 

From (|7.1I) . (j7.3p and the recursion [/„ — A„C/„_i we have 

= + MnC-^Cn-idn-i 

= w„ + M„ {C-^Cn-idn-i ~ d„) 

=: w„ + MJn. (7.4) 

Note that for n sufficiently large, f„ is the unique column vector for which A„w„_i — A/„f„ has no 
contribution from the vectors v^^ , Vj^ , . . . , v^j ^ . Equivalently, since the {v^}™ are eigenvectors 
for A, fn is the unique column vector for which (A„ — A)w„_i — M„f„ has no contribution from 
the vectors Vj^ , Vj^ , . . . , Vj,_j . This yields the estimate 

|f„| <c||A„-A|| |w„_i| (7.5) 

for a suitable constant c and for all n sufficiently large, on account of (|7.2p . Here we write | • | 
for the Euclidean norm of a vector and 1 1 ■ 1 1 for the induced matrix norm. 
Define 

R — A -M ^"^"-1 

W„_lW„_l 

with y^n-i denoting the conjugate transpose of w„_i. From (|7.4p we get 

while ([73), ([73]) and the fact that A„ A imply that 

|S„-y4„||^0, n^oo. 

We can now apply Lemma 17.11 to the matrices {Bn)n and the vectors (w„)„. This yields a 
sequence of nonzero constants (c„)„ such that c„w„ — >■ Vj^ for a certain index ji G [1 : m]. By 
the very construction of w„ we have that ji ^ {ji, . . . , The definition of the new sequence 

of upper triangular matrices of size / x / is obvious. □ 

7.2 Ratio and weak asymptotics of Riemann-Hilbert minors 

We will apply Lemma [7.21 to the polynomials Q„ generated by the three-term recurrence (|l.ip . 

xQ„{x) = Qn+i{x) + an-pQn-p{x), n > p. (7.6) 

We will assume that the recurrence coefficients a„ are asymptotically periodic with period r G N, 
where we may assume without loss of generality that r > p + 1. The case r < p can be handled 
by enlarging the period and/or by using Remark 16.41 
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We write the recurrence relation in matrix- vector form as (|6.14l) . recalling (|6.12p - (l6.13p . Since 
the recurrence coefficients a„ are asymptotically periodic with period r, we have 

lim {A„{x),Bnix),Cn{x)) ^ {Aix),B{x),C{x)), (7.7) 

with A{x) := —C{x)~^B{x) and B{x),C{x) as in (|6.12l) but with Um+j replaced by bj, j E [0 : 
r — 1] , and where the limits of the matrices are taken entrywise. 

In the proof of Theorem 1 2 . 1 41 we observed that the matrix A{x) is closely related to the block 
Toeplitz symbol F{z, x). More precisely, we showed that the non-zero eigenvalues of A{x) are the 
inverted roots 1/ Zk{x), fc G [0 : p] and the corresponding eigenvectors Vfe(a;) are given by (j6.16p 
(see also Remark 16. 3p . In addition the matrix A{x) has zero as an eigenvalue of multiplicity 
r — p — \. 

The second kind functions '^[^^ are defined in (jl.5l) . They satisfy the same recurrence relation 
(|7.6p for all n>p. In analogy with (j6.13l) we set 

*«(a:) (x), . . . Mrl^+r-ii^))^ (7.8) 

and we define the RH-type matrix 

Unix) -.^ (^Q^{x) *i''(x) ... ^i'\x)). (7.9) 
Then the recurrence (|6.14p extends to 

Un(x) = An{x)Un^i{x), n > 1. (7.10) 
Note the similarity with Lemma 17.21 Hence the next result should not come as a surprise. 

Proposition 7.3. Let Un{x) be the RH type matrix in (|7.9p . For any fixed a; G C \ IJ^- Tj, there 
exists a sequence of invertible upper triangular matrices Cn{x) of size p + 1 such that 

lim Pr;^?) a(x) = ( ^r^V") , (7.11) 

n^^\U„{x) J ' \z^^^\x)vj„{x) ... z^^'{x)v,Jx)J ^ ' 

where (jo, . . . ,jp) is a permutation of [0 : p] (depending on x), and with Vfc(a;) defined in (j6.16p . 
see also Remark \6.SX 

Proof. Throughout the proof we will drop the x-dependence for convenience. We want to apply 
the generalized Poincare theorem (Lemma 17. 2p to the recurrence (|7.10p . Recall that only the 
last p + \ columns of An are nonzero. So the matrix An could have zero as an eigenvalue (of 
multiplicity r — p ~ 1), contrary to the assumptions of Lemma 17.21 To resolve this issue, we 
partition 

Un\ /v, 



Un 



Un ' VV 



with Un and Un having r — p — 1 and p + 1 rows respectively, and similarly for Vj and Vj . We 
also partition 

with An and A square matrices of size p + \. 
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Recall that the nonzero eigenvalues of A are ^ , j G [0 : p] , and the corresponding eigenvec- 
tors are v,-. With the above partitions, this yields 



(A-z-^I).,^ ' ^ -rJ cO, (7.12) 




for all j e [0 : p]. In particular, the matrix A is diagonalizable with zj^ as eigenvalues, j € [0 : p], 
and the corresponding eigenvectors are vj (note also that (|7.12p implies Vj ^ 0). 
The recursion (|7.10p becomes 




(7.13) 
In particular, 

Un = A„Un^i, n>l. (7.14) 

We can now apply Lemma [7.2l to the matrices {An)n and ([/«)„. Observe that the matrices [/„ are 
all nonsingular (and so the matrices An); in fact, det?7„(x) is a nonzero constant (independent 
of x), as it follows from Prop. 12.61 Lemma [7.21 vields a sequence of invertible upper triangular 
matrices C„ such that 

&„_iC„^(v,o ... v,J (7.15) 

as n — )■ oo, for a certain permutation (jo, . • . ,jp) of [0 : p]. (Note that we write C„ instead of 
Cn-i-) Applying (|7.14p and (|7.15p we then get 

UnC'n = A„Un-lCn ^ [^Jg^'^Jo ■ ■ ■ ^JJ^'^Jp) > 

as rt — > CX3, where we used that An — s- A and Vj is an eigenvector of A for the eigenvalue z~^. 
On the other hand, from the first block row of (j7.13p we have 

UnCn = AnUn-lCn ^ A (vj^ . . . V^J = [^Jg^'^jo ■ ■ ■ ^JJ^'^Jp) : 

as n ^> oo, where the equality follows from the first block row of (|7.12p . Finally, 

Un-lCn = An-lUn~2Cn — ^n-l(^n-l) ^Un-lCn — > (vjj, . . . Vj^ ) . 

Combining the above limits, the proposition is proved. □ 

In principle, the indices jo, . . . , jp in Prop. 17.31 could depend on x. We will see further that 
this is not the case; in fact we have jo — 0, ji = 1, and so on. 

Fix fc G [0 : p]. Taking determinants of suitable (fc + 1) x (fc + 1) minors of (|7.1ip and using 
the fact that C„ is upper triangular, we find that 

lim Bk,rn^i{x)Cn{x) - {-l)f^(k+l)/2 ■ , V^- Jx)) , (7.16) 

lim^Bk,rn+r~i{x)cn{x) = {-1)'^(>^+^) (z^/ . . . z^i) dct (v^ (x), . . . , v^-^ (a;)) , (7.17) 

for any fixed x e C \ IJ^ Fj, where c„ denotes the determinant of the principal (fc + 1) x (fc + 1) 
submatrix of C„ , and where the vector consists of the last fc + 1 entries of Vj . For convenience 
we introduce the following notation: 

J S+ , for fc even, fc g [0 : p] , 

1 for fc odd, fc e [0 :p]. ^ ' ' 
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Lemma 7.4. Let k E [0 : p], and let x he a fixed point in€-\{[J-TjiJSk)- Then in (|7.16p - (|7.17p 

we have 

det(v;(x),...,v;-Ja;)) ^0. (7.19) 

Proof. Let Vj consist of the last p + 1 rows of Vj, as in the proof of Prop. 17.31 RecaU that the 
columns of the matrix 

(v,„(a;),...,v,,(x)) (7.20) 

are linearly independent, since they are eigenvectors corresponding to distinct eigenvalues of the 
matrix A (see the proof of Prop. [775)1 . In particular, there exist fc + 1 row indices such that the 
minor obtained by selecting these rows in (j7.20D is nonzero. Denoting the value of this minor 
with K,{x) 7^ and taking the determinant of the corresponding (fc + 1) x (fc + 1) minor in (j7.1ip . 
we get 

lim S(""'"i--"'=)(x)c„(a;) = ±k{x) / 0, 

n— >cx3 

for suitable indices Ui with rn — p — 1 < riQ < ni < ... < Uk < rn — 1, with again c„ the 
determinant of the principal (fc + 1) x (fc+ 1) submatrix of C„. Comparing this to (|7.16p . we get 

Jim Bfc,™_i(x)/B("« (x) = ±det (v;,,(x), . . . , v;^(a;)) /k{x). 

Now if (|7.19p fails, then this limit would be zero, thereby contradicting Lemma 15.11 (see also 
(El). □ 

Remark 7.5. The above proof shows that any (fc + 1) x (fc + 1) minor of 

obtained by selecting fc + 1 rows with the difference between the smallest and largest row index 
not exceeding p, is nonzero if a; e C \ (IJ^ Tj Li Sk)- Also recall Remark [Ql 

By Lemma [77^ we can take the ratio of (|7.16p and (|7.17p and get the pointwise limit 

lim Bk,rn-l{x)/Bk,rn+r-lix) = Zjg{x) . . . Zj^{x), X £ C \ (I JPj U 5fc). 

j 

Similar arguments can be applied for the other residue classes modulo r, showing that 

lim^Bk,n{x)/Bk^n+r{x) ^ z,„{x)...zj,{x), 2; G C \ ( |J Fj U 5fe) . (7.21) 

j 

Proposition 7.6. In Prop. \ 7.3\ we have for any fixed x G C \ (5+ U S-), 

(jo,...,Jp) = (0,...,p). (7.22) 

Prop. [7751 will be proved in Section [7751 In the latter section we also prove Theorem 12.21 in 
particular we show that C 5^ for all fc G [0 : ^i]. Note that we did not use Theorem [272] so far. 
Lemma [5. II and (I7.2ip ~ (|7.22p imply that, uniformly on compact subsets of C \ Sk, 

lim Bk.n{x)/Bk,n+r{x) = Zq{x) . . . Zk{x). (7.23) 
n—>oc 

We are now ready for the 
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Proof of Theorem \2.1l For any measure fi in C denote its logarithmic potential U'^ (x) as 



1 log 


xo - s 




X ~ s 



t/^(a;) = - j \og\x- s\ dAi(s). (7.24) 

We will prove formula (j2.2p for each sequence ^,k,n with n of the form rm + 1, I £ [0 : r — 1] fixed. 
Denote with k„ the leading coefficient of the polynomial Bk^n{x). We have uniformly for x in 
compact subsets of C \ Sk that 

lim (x) - i log I K„ I) =- lim -log|Sfc,„(x)l 

n— >oo \ n J n— >oo 77, 

^ m 1 ^ 

= - lim —y2^og\Bk,rj+i{x)/Bk,rU-i)+i{x)\ = -logTT |z,(a;)| = U'"'{x)+c, (7.25) 

with c a constant independent of x, and /i^ the measure in (II. 19^ . Here the first equality is 
obvious from the definitions (I7.24[) and (|2.1[) . the second one follows by telescopic cancelation, 
the third one follows by (j7.23p and the fourth one by ^7; Prop. 5.10]. It is easy to see that 
log iKnl/n is bounded from below as a function of n, due to (j5.ip and Prop. [5751 

Let Co{Sk) denote the space of continuous functions on the star Sk that vanish at infinity. 
Since ||/ifc,n|| < (p — k)/p for all n (cf. Lemma [1.21) . it follows from the Banach-Alaoglu theorem 
that we can extract a subsequence from fik,n that converges in the weak-star topology to a finite 
measure v supported on Sk- Let xq S C \ 5*^ be a fixed point. From the weak-star convergence 
and (|7.25p we deduce that for every x G C \ Sk, 

<\v{s) = Uf'-ix) -Uf^-ixo) = -Re^log J|zj(a;)) -he, (7.26) 

where log 0^=0 (^) ^ holomorphic branch of the logarithm of 11^=0 (^) ^^'^ ^ some 
constant. Note that (/)(s) := log S Co(S'fc), so the weak-star convergence indeed applies. 

We claim that 

/ log(l -I- |s|) di/(s) < oo. (7.27) 

This will be justified at the end of the proof and now we complete the argument as follows. 
From (I7.27P we obtain that is well-defined and superharmonic in C, and in particular we can 
replace the first integral in (|7.26D by U'^{x) — U'^{xo). Note also that the last relation in (j7.25p . 
which is in fact valid for all a; £ C, implies that f/'''' is continuous everywhere in the complex 
plane. This in turn implies, using (j7.26p and the superharmonicity of If^, that JJ" is bounded 
on every compact segment of Sk- Now we are in a position to apply Theorem IL1.4 from |25) . 
which gives ^k — v. 

Now we justify (j7.27p . This is equivalent to say that U^{x) > — oo for any fixed x e C \ Sk- 
it is clear that we can construct a non-increasing sequence of functions {km{y))rneN in Co(S'fc) 
satisfying km{y) = log (l/|x — j/|) whenever log(l/|x — y|) > — m and km{y) > for all y G Sk- 
Applying a standard monotone convergence theorem argument to this sequence km together with 
(|7.25p and the weak-star convergence to v, it is easy to deduce that U'^{x) > U'^''{x) + c, for 
some other constant c. 

Summarizing, we obtain that (j2.2l) is valid for every (j) € Co{Sk)- Since ||/ifc,Ti|| < (p — k)/p 
and ||/ifc|| — {p — k)/p, the convergence in the weak-star topology of ^Xk,n to /ifc implies that the 
sequence fik,n is tight. This implies again by a standard argument that (|2.2p is also valid for 
bounded continuous functions on Sk- □ 
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Remark 7.7. Due to the interlacing properties described in Theorem 14.61 it is easy to see that 
the conclusion of Theorem 12.11 remains valid for the zeros of general Riemann-Hilbert minors 
p(™+,:o,«+zi,...,n+ifc)^ ^j^jj j^. e z, j e [0 : fc], a fixed set of indices satisfying dO]). 

For later use, we state the next lemma. 
Lemma 7.8. Fix < k < I < p. Uniformly for x in compact subsets of C \ Sk, we have 

fo{zo{x),x) ... fQ{zk{x),x) 



fk-i{zo{x),x) ... fk-i{zk{x),x) 
fk(zo(x),x) ... fk{zk{x),x) 

(7.28) 

where the functions fj{z,x) are defined in (|8.16p . and Bk,i^n{x) :— 

Denoting with Ak the set of x € C for which the denominator in (|7.28l) is zero, then the set Ak 
is finite. For any x G Ak \ Sk the right hand side of (I7.28P has a removable pole at x. 

Proof. Remark 1 7 . 5 1 shows that the determinants in the numerator and denominator in (|7.28p are 
both nonzero if a; G C \ (S*-!- US'-). For any fixed such x, we obtain (|7.28p by taking determinants 
of suitable submatrices in Prop. 17.31 (with ji = i for all i). Lemma [5.11 shows the convergence 
holds uniformly on compact subsets oi C\ Sk. 

Finally, let us prove that Ak is finite. Let TZ be the compact Riemann surface with (fc+l)!(^^i[) 
sheets which are labeled by the ordered {k + l)-tuples {iQ,ii, . . . ,ik) in [0 : p]. On the sheet 
(iQ, zi, . . . , ik) we cut away all the sets r^^. and r.i^._i, j G [0 : A;]. If we cross such a cut, then we 
move to the sheet labeled by (io, ii, . . . ,ik) where ^j-, is the analytic continuation of Zi. through 
the cut. Now in the denominator of (|7.28l) we can replace the role of zq, • ■ • , ^^fe by ZiQ , ■ . ■ , Zi^ . 
The collection of all these functions yields a meromorphic function on TZ. Since we already know 
that this function is not identically zero on the sheet (0, 1, ... , fc), it can indeed have only finitely 
many zeros on that sheet. (Note that TZ can be disconnected; in that case we restrict ourselves 
to the connected component(s) involving the sheet (0, 1, ... , fc)). □ 

7.3 Proofs of Proposition 17.61 and Theorem 12.21 

In this section we prove Prop. 17.61 and Theorem 12.21 Note that we did not use Theorem 12.21 
prior to the statement of Prop. [7^ Moreover, it is a general fact [3 Prop. 1.1] that each set F^ 
associated to a Hessenberg matrix H consists of a finite union of analytic arcs. 

For each fc G [0 : p], the sequence {Bk,n{x) / Bk.n+r{x))^ for n tending to infinity converges 
pointwise for a; G C \ (IJ^ F^ D Sk), by (|7.2ip . and it is a normal family in C \ 5*^ by Lemma [CTl 
recall the definition of Sk in (j7.18p . Therefore, the convergence in (j7.2ip is in fact uniform on 
compact subsets of C \ 5*^ and the limit function Zjg (x) . . . Zj^ (x) is analytic there. Applying this 
observation subsequently for fc G [0 : p], we see that for each x G C, there exists a permutation 
{zj{x))^^Q of the set {zj{x))^^Q so that zq is analytic in C\5+, zqZi is analytic in C\5_, zo^i^2 
is analytic in C \ 5*+, Z0Z1Z2Z3 is analytic in C \ 5_, and so on (alternatingly with 5+ and 5_). 
In fact Zi Zj., i G [0 : p]. We also deduce from p.l6p that as x ^ 00, zo{x) — x^^ + 0{x^^^^) 
and Zj{x) — 0{x'^^^), j G [1 : p\, since it is clear that for x sufficiently large, zq{x) — zq{x). 

7.3.1 Proofs of Prop. [7^ and Theorem [2l2](a) 

The proof will proceed in a very similar way to the one in |8l Section 4]. For convenience, we 
will list the main highlights of the proof but we will sometimes refer to 8 for the details. We 
will assume without loss of generality that r is a multiple of p + 1, see also Remark 17.101 below. 



lim 



Bk,l,rn{x) 



n->-oo Bk,rn{x) 



fo{zn{x),x) 

fk-i{zo{x),x) 
fi{zo{x),x) 



fa{zk{x),x) 

fk-i{zk{x),x) 
fi{zk{x),x) 
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We already observed that for each A: G [0 : p] , 

hm Bk,n{x)/Bk,„+r{x) = ± Urn Pk^n{x)/ Pk^n+rix) = zo{x) . . . hix), X eC\Sk- (7.29) 



It fohows from (|7.29p and Theorem \2.7{ a.) that the functions Zi satisfy the symmetry property 
Zi{ujx) — Zi{x), where uj — exp(27ri/(p+ 1)); recaU that r is a muhiple of p+ 1. In accordance to 
this symmetry property, we define the functions 

yk{x) = Zfc(xi/(f+i)), fc e [0 : p], 

where we take the principal branch of x^^^p~^^\ (By the symmetry property, the choice of the 
branch is irrelevant.) Note that yk{x) is analytic in C \ R. 
Let us introduce the notation 

Rfe := (-1)'''R+, ke[0:p]. 

We now define a measure Sk on with density 

, I P+1 f yj+jx) y'k,-ix) \ 

dsfc(x) = — -r^ - -— ] dx, X G Rfe, (7.30) 

27ri r \yk,+ {x) Vk-{x) J 

/c G [0 : p — 1], where the prime denotes the derivative with respect to x, and where the + and — 
subscripts stand for the boundary values obtained from the upper or lower half of the complex 
plane, respectively. Note that the measure (|7.30|) is well-defined except for finitely many x, and 
its density is integrable near each endpoint of its support [IT]. We claim that Sk is a real- valued 
(possibly signed) measure on R^ with total mass 

Sfe(Rfc) / dsfc(x) = ^— , fce[0:p-l]. (7.31) 

jRfc P 

Indeed, since the polynomials Pk^n (|2.9p have real coefficients, it follows from (j7.29p that Zi{x) = 
Zi(x), where the bar denotes complex conjugation. This shows that is a real- valued measure. 
For a; e C \ Rfc , we have 

dSk{t) _ Ip+l 'r 1 / y;.+(t) y;._(t) \ p+l^y'^{x)^ ^^.^^^ 



x-i 2m r j^^J^^ x-t \yj^+{t) yj,-{t) ) r j^^yjixY 

where in the first equality we used the fact that X)j=o y'j{^)lyji^) — (l^S 11^=0 Hjix))' is analytic 
across Rfc , and the second equality follows by contour deformation and the residue theorem. From 
the behavior of the functions yj{x) near infinity we see that the right hand side of (j7.32p behaves 
as ^x~'^ + o{x~^) as x -> cx). This implies ((73T]) . 
We then obtain from (frSOl - lfTSTI) that 

i^/ lm(^)d..^, ke[0:p-ll (7.33) 

with Im denoting the imaginary part of a complex number. 

As in [5], we now turn to the construction of a second collection of auxiliary measures. The 
functions Zk{x) are unambiguously defined in the complement of lJfc=o '^hich is a finite union 
of analytic arcs. Consider the functions 

yfe(x) Zfc(a;i/(P+i)), fce[0:p]. 
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where we take the principal branch of x^/'^'^^'. The ib-boundary values of yk and y'/. are well- 
defined at almost every point x G Tk := ^^i^^ ■ This allows us to introduce the measures 



da;, 



X G Tfe. 



(7.34) 



The measure ak is closely related to the measure fik in (jl.l9p . In fact, for any Borel set B, 

ak{B) ^ ^jLk{h'\B)) (7.35) 
where h is the map x ^ x^^^ . In particular, Cfc is a positive measure and 

p — k 



a'fe(rfc) 



P 



fc G [0 :p - 1]. 



(7.36) 



Alternatively, (j7.36p could be proved directly by using the same argument as in (I7.3ip . 

Now let us take a fixed open interval J C K that does not contain any intersection points 
or endpoints of the analytic arcs constituting F^, for every k. We also ask J not to contain 
isolated intersection points of the sets with the real axis. Thus there exists an open connected 
set U C C such that U DM. = J and moreover U D Tk is either empty or equal to J, for any 
A: G [0 : p — 1]. The boundary values yk.+ {x) for x ^ J are then uniquely defined and they vary 
analytically with x. 

On the interval J, there exist indices < mi < m2 < . . . < rriL < p such that 

\yo,+ {x)\ = . . . = \ym,,+ {x)\ < |j/™i+i,+ (x)| = . . . = |2/,„2,+ (a;)| < • • ■ 

< \ym^+i^+{x)\ = ... = \yp^+{x)\, (7.37) 

for all X £ J. We define toq ^1 smd m^+i := p. 

We will see later that mk+i — ruk G {1, 2} for all fc, i.e., each "cluster" \yjnk+i,+ {x)\ = . . . = 
y„ifc+i,+ (2:)| hi (I7.37P can only have length 1 or 2. The Cauchy-Riemann equations imply [S] 



Im 



ymfc + l,+ (^) 



> 



> Im 



.ymk+i,+{x) 

and the numbers in (|7.38p satisfy the pairing 



ymk+i,+{x) 



Im 



mk+j,+ 



(x) 



ymk+j,+ ix) 



= -Im 



2/mfc + i + l-j,+ (2;) 



y 



l + l-3,+ {x) / ' 



X G J, fc G [0 : L], (7.38) 



j = l,...,mfe+i -TOfc. (7.39) 



The underlying reason for (j7.39p is that for any a; G M, the numbers yk,+ {x), fc G [0 : p], are 
either real or they come in complex conjugate pairs. This is trivial if a; > 0. If a; < it can be 
seen e.g. with the help of Lemma 11.31 taking into account that r is a multiple oi p + 1. 
Now we get 



fc=0 



> 



> 



fc=0 



1 p + 1 

27r r 

1 p+1 
27r r 



E 



Im 



fc=0 

Im 



E 

Ip 



yfc,+(^) 
yfc,+ (a;) 

yfe,+(a;) 
p-1 



da; 



dx 



1 

-E 

/c=0 



Im 



yk,+{x) 



dx > 



p-1 

E 

fc=0 



p — k 
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= 0, X e 



where the first relation uses (17.361) and the positivity of ak, the second relation follows exactly 
like in [5J Sec. 4], the third one follows since the numbers ijk form a permutation of the yk, and 
the fifth relation is a consequence of (j7.33p . Finally, the fourth relation uses that on R_|_ we have 
Im ( Ik^) = -Im f !k±L±(f)') and on R_ we have Im f Bh^) ^ _im f fk^i+^f^V for 
M+ this follows since 

V Im fy-M^] = 1 V - ^ 

due to the fact that (logy2/£y2fe+i)' is analytic on M^. 
From the above chain of inequalities we obtain: 

Lemma 7.9. (a) We have 

FfeCR, fce[0:p-l]. (7.40) 
(6) Clusters of length > 3 m (|7.37p cannot occur. 
The proof is exactly as in [S] . 

From Lemma [7?nta)~(b) we see that n Ffe_i contains at most finitely many points. We 
also have that (logyo ■ • • Uk-i)' is analytic in C \ Ffe-i, so in particular this holds on the interior 
of each interval of Ffe. Then ^^-^^ imply that 

/ Im ( ^) d. = .,(r,) = 6 [0 : p - 1]. (7.41) 

The measure ak is non-trivial on each subarc of Ffe (see the proof of Lemma l7.9f a)). From the 
positivity of at we also have 

> 0, X e int(f fc), 



= 0, X e K \ Ffe U Tk-1 



where mt{Tk) denotes the interior of F^ in the topology of M, where the first equality uses (j7.39p 
and Lemma rrW h*). 

Recall that yk{x) is analytic for x G C \ R. By Lemma [TjUJa) the same holds for the function 
yk (x) . Thus for each fixed fc G [0 : p] we have that yk (x) — yj^ [x] for all x G C \ R and for 
a certain jk which is independent of x. From (|7.4ip - (l7.42l) and (I7.33P we now easily find by 
induction on fc = 0, 1, . . . that jk = k and moreover F^ C Rfc. This proves Proposition 17.61 and 
Theorem [23ra). □ 



Remark 7.10. In the above proof we assumed that r is a multiple of p + 1. For general r, 
the symmetry properties take the form ^^(wa;) = uj^^Zkix) and Zk{ujx) = Lj~'^Zk{x) (Recall 
Lemma ll.3|) . Then the functions yk and yk have a jump on the whole of R_. But the logarithmic 
derivatives do not have such a jump, therefore the proof goes through in exactly the same way 
as above. 
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7.3.2 Proof of Theorem [HKb) (c) 



Fix fc G [0 : p — 1] and let r be arbitrary. Let / be an interval of Tk C Mfc. We will assume that 
Ffc is not the whole set R+ or M_ since otherwise there is nothing to prove. We claim that 



p+1 



gN, if/n{0,oo} 

<7kil)^{ en/ip + 1), no el, 

e N/p, if cx) G /. 



(7.43) 



Let us assume this for the moment. By breaking each interval / of in smaller subintervals 
if necessary, in such a way that (j7.43l) remains valid, we may assume that the left hand side of 
(|7.43p always lies in the range (0, 1]. Then we have from the total mass of at in (17.361) that 



p+1 



c 
P 



p — k 



p + I p 



k + 1 kr 

r , 

p + I p 



(7.44) 



where a denotes the number of intervals / of F^ for which the left hand side of (I7.43P equals 1, 
and where b e [0 : p] and c G [0 : p — 1] arc nonzero only if there is an interval / C Ffc containing 
or oo respectively and with the left hand side of (|7.43p being < 1. Since p and p+1 are 
coprime, from (|7.44l) we deduce that 



k + l 



k + 1 
p+1^ 



and — 



kr 
P 



kr 
P ' 



fcH 


^ 1 




kr 








P 



p + 1 p 
Inserting this in (|7.44p we get 



We then find for the total number rik of intervals of Ffc that 

k + 1 r/crl 

nk = — —r - — + Ifj^^^o + lc#o = 



where the indicator function Ix^o equals 1 ii x ^ and zero otherwise, and where the second 
equality uses that 6 7^ if and only if(fc + l)r/(p + l) and similarly c 7^ if and only if 
kr/p ^ N U {0}. This proves Theorem [S^lbl-fci. 

Finally we prove (|7.43l) . Due to (|7.35l) it will be enough to prove that 



'k + 1 ' 




kr 


71^ 

p+1 




_ P _ 



gN, if J n {00} 

G N/p, if 00 G J, 



(7.45) 



for any connected component J oi Tk C Sk- Thus J is either a line segment on Sk \ {0} (there 
are p+1 rotations of such a segment), or it is a set of the form J = {x € Sk \ \x\ < a} for some 
a > 0. 

The first statement of (|7.45p follows from fl\ Prop 2.10]. Let us check it directly ii J C Sk is 
a line segment of the form [a, b] with a,b ^ {0, 00}. From the definition (|1.19p of fik it is easy to 
see that 

fe k 

arg n ~ n - 



1 



(7.46) 



3=0 



where we take the argument function arg so that arg J^^^g ^ji^) is continuous in J7 \ J with U a 
complex neighborhood of [a, b) (U excludes b). This is possible since n^=o -^A^) '^^ analytic and 
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nonzero in C \ F^. But then the expression between brackets in (j7.46p is an integral muhiple of 
2tt, yielding the first statement in (|7.45p . 

To prove the second statement of (|7.45p . note that (j7.46p remains valid if b lies at cx). In 
that case, the behavior of the functions Zk{x) near infinity in (jl.l7p implies that the expression 
between brackets in (|7.46p is an integral multiple of 2tt/p. This proves (|7.45p . □ 



8 Nikishin system 

In this section we prove Theorem 12.101 on the connection with Nikishin systems. We start by 
recalling some ideas in [2]. 

8.1 Multiple orthogonality relations 

For any Id [0 : p], we define the sequence of monic polynomials iQn.i{x))'^^i by the recurrence 
relation 

xQn.l{x) = Qn+l,li^) + O-n-p Qn-pA^)^ n>l, (8.1) 

with initial conditions 



U.i 



{x) = l, Qi^i.iix) ^ ■ ■ ■ ^ Qi~pA^) = (8-2) 



Note that degQn,i = n — l and that Qn.o{x) = Qn{x). Moreover, thep+1 sequences [Qn,i{^))'n'={) 
form a basis for the space of all solutions ((j'n)^o to the difference equation 

Xqn = qn+l + fln-p ^n-p, " > P- 

Lemma 8.1. (The measures vi, . . . , Vp; see l^:) Suppose that an > for all n and the numbers 
an are uniformly bounded. There exists an increasing sequence of positive integers {nj)°°^Q such 
that for any fixed I Cz [I : p], we have 

(a) 

lim = / (8.3) 

j^oo Q{p+i)nj{x) J X-t 

uniformly for x in compact subsets ofC\ 5*+, where ui is a compactly supported measure 
on S+. 

(b) The moments of vi are uniquely determined from the condition (|8.3p . independently of the 
choice of the sequence {nj)°°^Q. 

(c) The measure vi can be written as 

di,i{t)^t'-'di>i{tP+'), (8.4) 

for a compactly supported, positive measure i>i supported on = IR+. Thus for I = 1 

the measure vi is rotationally invariant under rotations over 2tt/{p + 1) while for I > 1 it 
is rotationally invariant up to a monomial factor. 

Lemma Em was shown by Aptekarev-Kalyagin-Van Iseghem [5]. The key fact for (jS.Sp is that 
for any n G N and I G [1 : p] the zeros of Q{p+i)n,i{x) and Q{p+i)n{x) interlace (in a suitable 
sense) on the star-like set 5*+. The existence of a sequence {nj)^^^ such that (|8.3p holds then 
follows from the Helly selection theorem, see [5]. 
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Recall from Theorem 11.11 that the polynomials Q„ (x) are multiple orthogonal with respect 
to the measures i/i, . . . defined in (|8.3p , in the sense of (|1.4p . 

We will assume throughout this section that we are in the exactly periodic case (|2.17l) and 
that (j2.18p holds. We can assume that the sequence nj in (j8.3p is such that each {p + l)nj is a 
multiple of r; this follows directly from the freedom in choosing a convergent subsequence in the 
proof of Lemma 18.11 in [2] . For a fixed I E [0 '■ p], let 

Tn{x) := Q„+i^i{x), n > 0. 

By (|8.ip and (|8.2p . this sequence satisfies 

xTn{x) = Tn+i{x) + a„+i_pr„_p(x), n>0, (8.5) 

with initial conditions 

Toix) = l, r_i(a;) = --- = r_p(x) =0. (8.6) 

It follows that the block Toeplitz symbol associated with (T'„)^q is Z~^F{z,x)Z^ , with Z and 
F given by p.l2p and (jl.lOL respectively. 

Using Theorem l2 . 141 and simple considerations, we deduce that for any index sequence {nj)'j^Q 
as described above, we have 

Qi,^.y,A-) ^ ^pK^ ^ ^^p^, le[0:pl (8.7) 
j^oo y(p+i)„^(a;) j^oo y(j,+i)„^ (x) ;o[zq[x),x) 

uniformly on compact subsets of C \ 5+, where the functions /; are the following minors of the 
block Toeplitz symbol: 

Mz, x) = i-iyz-' det F^-'^°iz, x), 
fiiz,x)^i-iydetF'-''°iz,x), le[l:r]. 

Note that the functions fi{zQ{x),x), I G [0 : p], are analytic in C \ Fq, and that fQ(z,x) has an 
extra factor z^^ in comparison to the other functions fi{z, x). Let 

Aq :~ {x £ C\To : o^^)^ ^) -^^^ ^ non-removable pole at x for some Z € [1 : p]}. 
fQ(zo[x),x) 

From the statement of Theorem 12.141 we know that the set is finite. Moreover, since the 
functions Qn,i{x)/Qn{x) are analytic on C \ 5+, we deduce from (|8.7p that Aq C S+. 

8.2 Formal Nikishin system 

In this section we will introduce a hierarchy of functions fi^k, ^ k < I < p, which will be 
identified later as the Cauchy transforms of certain measures that form the different layers of a 
Nikishin system on (Fg, . . . , Fp_i). 
From ((O) and ((O) we obtain 

M{t) fi{zo{x),x) f f t \ \ 7 ^ ri 1 
7 = r / / ^ — T fi.o{za{x), x), I € [1 : p], 8.9 

for X £ C \ (Fo U .4o). The measures i^i and the functions fi^ will form layer of the Nikishin 
hierarchy, as we will show later in this section. We also deduce that the measures vi are supported 
on Fo U A- 
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We consider the functions 

fl,Qizo,+ {x),x) - flfi{zQ-{x),x) 



fi,aizo,+ {x),x) - fifi{zo-ix),x) ' 



X G To, 



I ^ [2 : p]. (These expressions will be well-defined as we will show in the next section.) The 
relations zo^± = zi.^ on Fq imply that these functions can be meromorphically extended to 
C \ Fi; we denote the resulting functions by 



/;,i(^o(a;),^^i(a;),a;) 



.fi.,o{zi{x),x) - fi,o{zo{x),x) 

fl,o{zi{x), X) - fifi{zo{x), x) ' 



(8.10) 



and we observe that is a symmetric function of its two arguments zq and zi. This will form 
layer 1 of the Nikishin hierarchy. 
Next we consider the functions 



fiAzo{x),zi^+{x),x) - fi^i{zQ{x),zi-{x),x) 



X G Fi, 



f2,i{zo(x),zi,+{x),x) - f2,iizo{x),zi,_{x),x)' 
I & [3 : p]. They can be extended to C \ F2 by the functions 

fi,i{zo{x),Z2{x),x) - fi^i{zo{x),zi{x),x) 



fL2izo{x),Zi{x),Z2ix),x) 



/2,1 (^0 {x) , Z2 (x) ,X) - f2,lizo{x), Zi (x) , x) ' 



(8.11) 



and we observe that //^2 is a symmetric function of its three arguments zq,zi,Z2 (this is a bit 
harder to see now) . This will form layer 2 of the Nikishin hierarchy. 
We can continue this procedure and set 



fl,kiM^)^ - ■ ■ ^^k{x),x) 

_ fi,k-i{zo{x),. 



, Zk-2ix),Zk{x),x) ~ fi^k-l{zo{x), Zk-2{x), Zk-l{x),x) 



fk,k-l{zo{x), ... , Zk-2{x),Zk{x),x) - /fc,fc_i(zo(x), . . . , Zk-2{x),Zk-l{x),x) ' 

for I E [k + 1 : p] and fc G [1 : p — 1], using induction on k. It allows a determinantal formula: 



Lemma 8.2. Consider the functions fi, I G [0 : p] in (j8.8l) . Define the hierarchy of functions 
fi,k, < k < I < p, as explained above. Abbreviating fi{zk{x)) := fi{zk{x),x) for each I, we have 



fi,k{zo{x), . . .,Zk{x),x) = 



fo{zo{x)) 

fk-i{zo{x)) 
Mzo{x)) 



fo{zk{x)) 

fk-i(zk{x)) 
fi{zk{x)) 



foizoix)) 

fk-i{zo{x)) 
fk{zo{x)) 



fo{zk{x)) 

fk-i{zk{x)) 
fk{zk{x)) 



(8.12) 



We also have 
fi,k,+ {za{x), 



■ ■,Zkix),x) - fi^k-izo{x), 
fo{zo{x)) ... 



• ■,Zkix),x) - 
fo{zk-i{x)) 



fk-i{zQ{x)) ... fk-i{zk-i{x)) 



foizo{x)) . . . fo{zk+i{x)) 



fk{zo{x)) 
fi{zo{x)) 



fk{zk+i{x)) 
fi{zk+i{x)) 



fa{za{x)) . . . fo{zk{x)) fo{zo{x)) . . . fo{zk-i{x)) /o(zfe+i(a;)) 



fk{zo{x)) . . . fk{zk{x)) 



fk{za{x)) . . . fk{zk-i{x)) fk{zk+i{x)) 



(8.13) 
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for a; G Ffc, where in the right hand side of (j8.13p we define the values Zj{x) as the limiting 
values obtained from the +-side ofTk (picking another labeling of the Zj{x) so that (|1.15p holds 
can only change the sign in (j8.13p ), and where we set the determinant of an empty matrix as 1. 

Proof. The determinantal formulas folfow by induction on fc = 0, 1, 2, ... by means of a basic 
linear algebra calculation using Sylvester's determinant identity |14j. See also |1] Sec. 8]. □ 



Remark 8.3. As in the proof of Lemma 17.81 we see that the denominator in the right-hand side 
of (I8.12p vanishes only for finitely many x G C. Taking into account the relations Zi,± = -Zi+i^ip 
on Ti, j G [0 : fc — 1], we see that the ratio in (|8.12p is in fact analytic in C\ {Tk UAk), where Ak 
is a finite set in C \ Ffc . 

Lemma 8.4. Let r be a multiple of p and assume the ordering (I2.18p . For any < k < I < p 

there exists C ^ such that the following asymptotics hold for x ^ oo: 



fo{zo{x)) 
fk-i{zo{x)) 



fo{zk{x)) 

fk-i{zk{x)) 
fi{zk{x)) 



fa{za{x)) 

fk-i{zQ{x)) 
fk{zo{x)) 



fa{zk{x)) 

fk-i{zk{x)) 
fk{zk{x)) 



Cx'=-'(l + 0(x-P-i)). 



The proof of Lemma 18.41 is postponed to Section 
For convenience, we define a new symbol: 



F{z,x) PrF{z,xfPr, 



(8.14) 



where Pr is the r x r permutation matrix that consists of I's in the main antidiagonal and O's 
elsewhere, i.e., the entry of Pr equals (5i+j_r+i, for i,j G [0 : r — 1]. Note that F{z,x) is 
the reflection of F{z, x) with respect to its main antidiagonal. We can rewrite (|8.8p as 



fo{z,x) = {-lYz-^detF--^^''{z,x), 
fi{z,x) = (-l)'deti?--i^^'^-'(z,a;). 

We also define the functions 

fo{z,x) = {-iyz-^detF''-^'°{z,x), 
fi{z,x) = (-l)'det^^'^-i— '(z,a;). 



/ G [1 



/ G [1 : r] 



(8.15) 



(8.16) 



8.3 Proof of Theorem ICTTl 

Lemma 18.21 asserts that the measures Vj form a formal Nikishin system in the sense of [1] . To 
prove Theorem 12. 101 we will now show that they are a true Nikishin system. 

Theorem 8.5. (Nikishin property.) Let H be the two-diagonal Hessenberg matrix (|2.6p . with 
entries an > that satisfy (|2.17p - (|2.18p . For each pair of indices k, I with < k < I < p, 

fiA^oix), Zk{x), x)^ f ^nM^ (8.17) 

J x~t 

for a measure v^k supported on Tk U Ak, where Ak is a finite subset of Sk \ F^ (S^ \ Tk) if 
k is even (odd). The measure vi^k takes the form (j2.20[) . for a measure Di^k with constant sign 
supported on M_|_ (&.-) if k is even (odd). 
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Proof. By (|8.9p we know that (I8.17P is valid for fc = and Z e [1 : p] • We also know already that 
the measures i^i,o are supported on Fq U ^o, with Ao a finite subset of S+ \ Fq, and that (|2.20p 
holds for A: = 0. 

In what follows we are going to work with the polynomials associated with the symbol F 
introduced in (|8.14p . That is, we consider now the two-diagonal Hessenberg operator H with 
periodic structure whose first r coefficients are given in the following order: 

We associate with the new operator H the polynomials Pk,i,n as defined in Section [2T4l These 
are the polynomials we will employ below. 
Let I < /c < Z < p. Applying Theorem B. 1 2[ 

Pk,i,u{x) ^ ^k-i Pk,i.n{xP+^) 

where the zeros of Pk.n and Pk,i.n lie in M+ (K_) if k is even (odd), and are weakly interlacing. 

Let us denote by dn the degree of Pk,n- Thanks to the weak interlacing property, we know 
that either deg Pk^i^n — dn or deg Pk^i^n ~ d„ + I. In any case, we can write 

Pk,l,n{z) , ai^n 

— — — = a_i,„ + > , 

zPk,n(Z) i=0^~^*'" 

where xo,n ■— 0, {a^i.njf^i denotes the zeros of Pk.n, and for i > 0, we set = if z — Xi^n is a 
common factor of the numerator and denominator. It also follows from the interlacing property 
that all the coefficients {cti.n}iZQ have the same sign. 

Assume for the moment that k is even, so the zeros of Pk^n lie in K+. Let h'i^k,n be the discrete 
measure supported on {xi^n}iZo with mass Ui^n at Xi^n- Hence 

Pk.iA^) fdi^^_ (8.18) 



zPkA^) ' J 

It is easy to check that q;^i^„ < if i'i^k,n ^ 0, and a_i^„ > if vi^k,n < 0. Therefore the function 
(j8.18p maps (— oo,0) into (— oo,0) if vi^k,n is positive, and maps (— oo,0) into (0,cxd) if i'i_k.n is 
negative. Moreover, it maps the upper half plane into the lower half plane (upper half plane) if 
vi^k,n is positive (negative). 

An important ingredient in our proof is formula (|7.28p . which certainly applies in our situ- 
ation. We should apply this formula for the i?-polynomials associated with the operator H (or 
the symbol F). Therefore, taking into account (|8.15p - (l8.16p . the determinants in the right-hand 
side of (17.281) are in this situation constructed with the functions fk{z,x). 

We know by Lemma 17.81 that 

lim ^t^blM G(z), 
zPk. Jz) 

uniformly on compact subsets of C \ [0, oo). Since G ^ 0, the measures iy'i^k,n are all positive for 
n sufficiently large, or they are all negative for n sufficiently large. Therefore G is an analytic 
function in C \ [0, oo) that satisfies one of the following properties: 
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(a) G{x) < for all x e (—00, 0) and G maps the upper half plane into the lower half plane, 
(6) G{x) > for all x G (— cxd, 0) and G maps the upper half plane into the upper half plane. 
Applying Theorem A. 4 from we deduce that 

G{z)^a + J^^^, zeC\[0,oo), 

where a G M and vi^k is a measure with constant sign supported on 

In particular, applying the above equations together with (|7.28p . p.4p . and (|8.12l) . we obtain 

uniformly on compact subsets of C \ 5+. Now, Lemma [8.41 implies that a — 0. Finally, using 

,k-l+p+l 1 ^ ^^2^^^k-l+l 

m=0 

we deduce 



'' ^' -^«,-n a; — e p+i s 



h^xP+^~t p+lJs+ x-s '-'^ ^ 

This justifies (j8.17l) and (j2.20p with vi^k '■— ^^p]-i — ^Lk- and we see from (|8.19p that the function 
fi,k{zo(x), . . . , Zk{x), x) has no singularities outside 5+. The proof is analogous for odd values of 
k. It is clear from the analyticity of fi,k{zo{x), . . . , Zkix),x) on C \ (Tfc U Ak), see Remark [8?3l 
that the measure vi^k is supported on Tk U Ak- □ 



Proof of Theorem \2.1(k We have precisely shown in Theorem 18.51 that if dvi^kix) — gi^k{x) dx 
dv''f^{x) denotes the Lebesgue decomposition of vi,k, then for ^ G [fc + 2 : p], 

9i,k{x) _ fi^k,+ {zo{x),...,Zk{x),x) - fi^k-{zo{x),...,Zk{x),x) 



gk+i,k{x) fk+i,k,+{za{x), Zk{x),x) - fk+i,k-{zo{x), Zkix),x) ' 



X G Tfc, 



is expressible as the Cauchy transform of a measure vi^k+i supported on the star complementary 
to Tfc. ' □ 

8.4 Proof of Lemma 18.41 

In this section we will prove Lemma 15^ First we establish the following result. 

Lemma 8.6. (Asymptotics of fj{zk, x):) Let r he a multiple of p and assume the ordering (|2.18p . 
The functions fj{zk{x), x) in (|8.8I) behave for x 00 as 

fo{zo{x), x) = {-Ifx^ + O(x'-f-i), 
/o(zfc(x),x)=0(a;--P-i), fce[l:p], 

and 

fj{zo{x),x) = i-iyx--^ + o{x^-i-p-^), 

fj{zkix),x) = C,.kx--^ +Oix--^-P-'), fc G [1 : j], (8.21) 
fj{zk{x),x)^0{x--^-P-^), ke[j + l:p], 

for J G [1 : p], for certain constants Cj^k 7^ 0, k < j. 
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Note that the O-terms jump with powers of x~p~^ rather than x~^. This is due to the 
rotational symmetry under rotations with exp(27ri/ {p + 1)). 
Lemma 18.61 imphes that for I > k, 

( Io{zo{x)) ... fo{zk{x)) ^ 

fk-i{za{x)) ... fk-i{zk{x)) 
V fi{zo{x)) ... fi{zk{x)) 





diag(x'^, x"^ 


-1 ^r-feH 
, . . . , x 






[I 


0(a;-P-i) 


CI(a;-P-i) 


... 0(a;-P-i) 


0{x-P-^)\ 


1 






... 0{x-V'^) 


0{x~P'^) 


1 


C2,l 




... CI(a;-P-i) 


0{x-P-^) 


1 


Cfc_i,i 


Cfc_l,2 


Cfc-i,fc-i 


0{x-P-^) 






C;,2 


Ci^k-i 


Ci^k J 



where each Cj^k is a non-zero constant. Therefore, 
fa{zo{x)) ... fo{zk{x)) 



fk-i{zo{x)) 
fi{zo{x)) 



fk-i{zk{x)) 
fi{zk{x)) 



C2.r+(r-l) + ... + (r-fe+l) + (r-0(l + ©(a;-^-!)), 



B.22) 



for some constant C 7^ 0. Taking ratios of such determinants, we then get the desired Lemma[i 
In the rest of this section we prove (|8.20p - (l8.21l) . First of ah, the statements involving zo(a:) 

follow easily from the Widom-type formula (|2.25p (applied to the antidiagonal reflected symbol 

(|8.14p ) taking into account that 2:0(2;) ~ x^'' and zi{x) ^ . . . , Zp{x) — 0{x^^p) for x 00, and 

that zoix) . . . Zp{x) = (-l)''+P/fp. 

Next, we prove (|8.20p - (l8.2ip for the functions Zk{x) with fc > 1. Let e C be the standard 

basis vector which has all its entries equal to zero except for the entry in position j, which is 

equal to 1. Let P be the permutation matrix of size r x r which acts on the vectors by the 

rule 

for any a G [0 : r/p — 1] and 6 G [0 : p — 1]. Let D be the r x r diagonal matrix 



D 



liag (^/p,z-/p, 



2e j 

Z ^ Ir, 



l.2i) 



We conjugate the block Toeplitz symbol F{z^ x) by the matrices D and P. This results in the 
following matrix: 



/Ao / 

Q Ai I 



PDF{z,x)D-^p-^ = 



Ap_3 / 
ylp_2 




\ 





/ 



5.24) 
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with Z := 



Ir/p-l 

1 



and 



/ -X 



A, 





V 



p/r 



ar-ZpJrjZ'Pl'' 





^r—p+j"^ 1 






0,r~2p+'jZ- 



p/r 



J 



5.25) 



for j £ [0 : p — 1]. Note that each of the blocks in (j8.24l) is a square matrix of size r/p by r/p. 

Fix fc e [1 : p]. We aheady know that Zk{x) ^ CkX^^^ as a; ^> cxd. Hence z^^^{x) ^ C^!"^ x 
From (IH211)-(E1S1) and the fact that A%XF{zk{x),x) we see that (see also (g^l)) 

I r/p—1 r/p—1 r/p—l 



Combining this with (|2.18l) and (11.15^ . we obtain that for x — ?• oo, 



?.26) 



Now we consider det x), i.e., the determinant obtained by skipping the jih row 

and the first column of F{z,x), j G [1 : p]. Clearly, this determinant is not infiuenced by 
the conjugation with the diagonal matrix D in (I8.23p . in the sense that det ^^"^'"(2, x) = 
det{DFD~^y~^''^{z,x). For a matrix A denote with A the matrix obtained by skipping the 
first row of A and with A the matrix obtained by skipping the first column of A. Then from 
((04)) we obtain 



[Ao I 

Ai I 



detF^-i'°(z,x) = ±det 



A,-i I 



A, I 



Ap^2 I 



Now by repeated Gaussian elimination with the identity matrices / as pivots, the above deter- 
minant can be brought to the form 



deiF^-^'°{z,x) = ±det ' ^''^ 



(±Aj^i.^.AiAq I 
\ Z ±Ap_iAp_2 ■ • ■ Aj^ 



i.27) 
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Fix k G [1 : p]. To obtain the dominant behavior of (I8.27|) for z = Zk{x) as a; — >■ oo, we 
should only use the (1, 1) and the (2, 2) blocks in (|8.27l) . Note that both blocks are square. The 
determinant of the (2,2) block can be simply factored as (det Aj){det Aj^i) . . . {det Ap^i) with 



det Ai{z = Zk{x)) 



0(a;'-/p-P-i), otherwise. 



(8.28) 



for some Ci,k ^ 0, thanks to (|8.26p . The determinant of the (1,1) block can be expanded by 
means of the Cauchy-Binet formula: 



det M 



. . AiAq 



r/p— 1 
mi ,. . .,mj _ 1 —0 



nij ,mj_i 

i 



)...(detA5"^''"^)(detA™^^""), 



^.29) 



where the sum runs over all {j — l)-tuples of integers (mi, . . . , rnj_i), each of them ranging 
between and r/p — 1, with boundary conditions mo = rrij :— 0. We remind the reader that 
A^'^ denotes the submatrix of A obtained by deleting row i and column j. Clearly, 



det ^^'+^'"'(2 = Zk{x)) = +0(x'-/f^P-2)^ 
for all i € [0 : j - 1]. Using this in (|8.29l) we get 



a,k + 0, 



det ( . . . AiAo ) (z = Zk{x)) = C,.k x^-\\ + O(x-f-i)) 



(8.30) 



as a: — cxd, for a new constant Cj.fe. This constant Cj^k is nonzero, since cancelation of the 
leading order terms in the sum in (|8.29p cannot occur. This is due to Lemma [5771 below. 

By combining (j8.27p . (|8.28p and (j8.30D . we obtain the desired asymptotics in (j8.2ip for z = 
Zk[x) with fc G [1 : p]. 

The asymptotics in (|8.20|) can be proved by a similar argument. We now have the relation 



-MetF'-i'"(z,x) = z-'pI'' det{DFD- 



l\r-l,0 



(z,a;). For a matrix A denote now with A the 



matrix obtained by skipping the last (rather than the first) row of A and denote again with A 
the matrix obtained by skipping the first column of A. Then by Gaussian elimination we get the 
following analogue of (|8.27p : 

z"^ det F'^^^'^iz, x) = ±z'P/'^ detiz-P/^^I ± . . . AiAq), 

where z~p^'^I arises as the submatrix obtained by skipping the last row and the first column of Z. 
Clearly, the dominant behavior for z = Zk{x) as x — oo comes from ±2;"^/'' det(Ap_i . . . AiAq). 
This determinant can be evaluated using Cauchy-Binet in the same way as before. Then we easily 
get the asymptotics in (|8.20p for z = Zk {x) with fc e [1 : p] . This ends the proof of Lemma [ 
□ 



To conclude this section, we state the following lemma which was used above. 
Lemma 8.7. Let A be an n x n matrix of the form 



ao 



A^ 



ai 



an-2 



-bn-l) 
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with ak,bk > for all k ^ [0 : n — 1]. Denote with A'^'^ the submatrix obtained by skipping the 
kth row and the Ith column of A. Then 

{^^ly+k+i+i AKi > 0. 
Proof. Straightforward verification. □ 
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